-- Logs begin at Thu 2021-12-23 11:17:09 UTC, end at Thu 2021-12-23 12:21:41 UTC. -- Dec 23 11:50:08.886240 dv-cinder-822821-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 23 11:50:08.895763 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 23 11:50:08.898279 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Dec 23 11:50:08 2021] *** Dec 23 11:50:08.898279 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 23 11:50:08.898279 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 23 11:50:08.898279 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: nodename: dv-cinder-822821-1-iscsi Dec 23 11:50:08.898279 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: machine: x86_64 Dec 23 11:50:08.898279 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: clock source: unix Dec 23 11:50:08.898279 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: pcre jit disabled Dec 23 11:50:08.898279 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: detected number of CPU cores: 4 Dec 23 11:50:08.898279 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: current working directory: / Dec 23 11:50:08.898279 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: detected binary path: /usr/bin/uwsgi-core Dec 23 11:50:08.898279 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: your processes number limit is 47680 Dec 23 11:50:08.898279 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: your memory page size is 4096 bytes Dec 23 11:50:08.898279 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: detected max file descriptor number: 2048 Dec 23 11:50:08.898279 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: lock engine: pthread robust mutexes Dec 23 11:50:08.898279 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: thunder lock: enabled Dec 23 11:50:08.898279 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 23 11:50:08.899793 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 23 11:50:08.942108 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: Python main interpreter initialized at 0x5625428b39c0 Dec 23 11:50:08.942108 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: python threads support enabled Dec 23 11:50:08.942108 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: your server socket listen backlog is limited to 100 connections Dec 23 11:50:08.942108 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: your mercy for graceful operations on workers is 90 seconds Dec 23 11:50:08.942550 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: mapped 403077 bytes (393 KB) for 2 cores Dec 23 11:50:08.942550 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: *** Operational MODE: preforking *** Dec 23 11:50:08.942833 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: *** uWSGI is running in multiple interpreter mode *** Dec 23 11:50:08.942833 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: spawned uWSGI master process (pid: 101763) Dec 23 11:50:08.943053 dv-cinder-822821-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 23 11:50:08.943769 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: spawned uWSGI worker 1 (pid: 101764, cores: 1) Dec 23 11:50:08.943957 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: spawned uWSGI worker 2 (pid: 101765, cores: 1) Dec 23 11:50:08.944056 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 23 11:50:10.701877 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 23 11:50:10.701877 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: from cryptography.utils import int_from_bytes Dec 23 11:50:10.702655 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 23 11:50:10.702655 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: from cryptography.utils import int_from_bytes Dec 23 11:50:10.702795 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 23 11:50:10.702795 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: from cryptography.utils import int_from_bytes Dec 23 11:50:10.702795 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 23 11:50:10.702795 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: from cryptography.utils import int_from_bytes Dec 23 11:50:13.282885 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 23 11:50:13.283560 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 23 11:50:13.283646 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 23 11:50:13.283959 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 23 11:50:13.284236 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 23 11:50:13.284626 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.284949 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.285272 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.285591 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.285915 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.286216 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.286553 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.286877 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.287205 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.287461 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.287795 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.288101 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822821-1-iscsi {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.289207 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.289531 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.289946 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.290273 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.290669 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.291165 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.291501 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.291997 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.292755 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.293075 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.293182 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 23 11:50:13.293554 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.293642 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 23 11:50:13.293714 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.293979 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 23 11:50:13.294098 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.294327 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.294435 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 23 11:50:13.294679 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.294785 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 23 11:50:13.294990 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.295089 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.295317 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.295483 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.295601 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.295819 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.296003 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822821-1-iscsi {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.296196 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.296334 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.296538 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.296650 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.296857 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.296981 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.297186 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.297374 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.297564 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.297758 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.297970 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.298163 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.298287 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.298445 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.298614 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.298715 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.298804 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822821-1-iscsi {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.298898 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.299023 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.299213 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.299344 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.299536 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.299673 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.299859 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.299959 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.300179 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.300281 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.300480 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.300584 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.300791 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.300895 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.301097 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.301387 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.301578 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.301676 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.301767 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.301997 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.302104 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.302247 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.302348 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.302579 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.302684 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.302898 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.303001 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.303219 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.303316 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.303539 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.303679 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.303805 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.303902 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.304022 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.304185 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.304349 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.304501 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.304651 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.304888 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822821-1-iscsi {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.304983 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.305210 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.305308 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.305526 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.305619 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.305834 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.305940 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.306292 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.306407 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.306688 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.306781 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.306927 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.307022 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.307234 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.307327 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.307553 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.307652 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.307873 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.307967 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.308194 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.308282 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.308502 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.308596 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.308823 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.308911 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.309158 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.309251 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.309460 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.309552 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.309769 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.309862 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.310081 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.310168 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.310404 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.310492 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.310738 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.310845 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.311047 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.311145 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.311297 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.311397 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.311609 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.311709 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.311937 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.312033 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.312249 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.312342 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.312573 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.312674 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.312824 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.312918 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.313078 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.313210 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.313402 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.313502 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.313724 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.313816 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.314037 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.314136 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.314349 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.314437 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.314679 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.314767 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.314989 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.315087 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.315296 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.315397 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.315599 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.315686 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.315905 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.315999 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.316213 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.316337 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.316521 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.316629 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.316828 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.316935 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.317136 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.317238 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.317441 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.317541 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.317747 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.317852 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.318055 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.318175 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.318361 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.318455 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.318704 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.318811 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.319024 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.319117 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.319331 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.319418 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.319637 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.319731 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.319941 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.320026 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.320247 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.320345 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.320564 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.320657 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.320866 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.320950 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.321172 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.321258 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.321490 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.321755 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.321981 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.322110 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.322288 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.322497 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.322620 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.322857 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.322944 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.323162 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.323255 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.323472 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.323565 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.323785 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.323938 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.324088 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.324215 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.324395 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.324531 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.324700 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.324834 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.325006 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.325133 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.325314 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.325457 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.325619 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.325745 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.325925 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.326059 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.326229 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.326440 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.326596 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.326704 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.326839 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.326968 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.327178 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.327303 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.327431 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.327543 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.327751 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.327878 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.328072 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.328183 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.328384 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.328509 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.328680 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.328792 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.328983 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.329103 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.329291 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.329413 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.329636 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.329750 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.329924 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.330052 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.330232 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.330358 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.330578 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.330720 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.330916 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.331040 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.331227 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.331371 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.331559 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.331733 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.331928 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.332060 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.332190 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.332415 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.332554 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.332749 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.332876 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.333108 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.333243 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.333426 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.333564 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.333770 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.333945 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.334134 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.334254 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.334469 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.334614 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.334814 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.334928 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.335133 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.335246 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.335453 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.335574 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.335768 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.335896 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.336087 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.336215 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.336539 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.336703 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.336836 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.336967 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.337100 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.337300 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.337478 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.337618 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.337964 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.338103 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.338284 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.338435 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.338637 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.338780 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.338953 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.339081 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:50:13.339276 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.339409 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.339572 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.339711 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.339889 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.340023 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.340203 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.340332 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.340537 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.340676 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.340850 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.340976 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.341162 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.341297 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.341501 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.341636 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.341823 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.341957 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.342139 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.342276 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.342447 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.342611 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.342786 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.342913 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.343093 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.343219 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.343406 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.343535 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.343714 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.343843 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.344034 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.344161 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.344360 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.344500 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.344670 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.344796 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.344994 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.345137 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.345302 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.345437 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.345616 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.345750 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.345929 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.346069 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.346784 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.346908 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.347014 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.347133 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.347239 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.347353 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.347469 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.347581 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.347688 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.347793 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.347905 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.348019 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.348131 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.348242 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.348356 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.348530 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.348681 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.348869 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.348980 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.349186 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.349306 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.349506 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.349789 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.349968 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.350131 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.350287 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.350450 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.350678 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.350855 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.351032 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.351207 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.351389 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.351543 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.351719 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.351899 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.352053 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.352241 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.352446 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.352740 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.353103 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.353268 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.353426 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.353595 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.353595 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.354035 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.354161 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.354269 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.354373 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.354477 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.354621 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.354730 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.354844 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.354844 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.355041 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.355149 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.355252 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.355362 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.355483 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.355619 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.355731 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.355843 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.355950 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.356073 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.356179 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.356352 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.356473 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.356797 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.356920 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.357037 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.357151 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.357263 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.357387 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.357564 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.357678 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.357972 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.358099 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.358229 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.358352 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.358474 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.358670 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.358837 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.358970 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.359155 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.359280 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.359472 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.359601 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.359791 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.359918 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.360100 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.360235 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.360418 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.360547 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.360729 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.360855 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.361044 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.361175 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.361353 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.361505 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.361672 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.361828 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.361953 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.362076 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.362276 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.362405 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.362616 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.362744 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.362932 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.363072 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.363246 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.363680 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.363891 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.364018 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.364182 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.364318 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.364487 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.364612 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.364797 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.364921 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.365106 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.365241 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.365416 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.365551 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.365725 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.365852 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.366034 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.366169 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.366342 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.366476 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.366687 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.366813 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.367020 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.367157 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.367281 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.367403 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.367570 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.367697 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.367878 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.368006 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.368197 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.368322 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.368672 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.368805 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.368939 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.369085 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.369211 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.369334 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.369539 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.369669 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.369850 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.369978 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.370168 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.370301 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.370476 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.370625 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.370814 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.370943 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.371143 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.371277 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.371455 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.371589 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.371773 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.371900 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.372089 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.372213 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.372403 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.372536 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.372715 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.372850 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.373026 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.373152 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.373338 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.373475 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.373644 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.373770 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.373953 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.374079 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.374264 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.374403 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.374599 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.374725 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.374915 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.375044 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.375227 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.375361 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.375535 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.375662 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.375851 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.375978 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.376161 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.376297 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.376467 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.376607 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.376774 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.376901 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.377096 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.377229 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.377422 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.377520 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.377742 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.377850 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.378063 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.378171 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.378389 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.378498 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.378711 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.378800 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.379022 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.379117 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.379422 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.379519 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.379659 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.379755 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.379969 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.380062 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.380277 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.380361 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.380582 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.380684 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.380914 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.381005 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.381227 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.381312 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.381536 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.381633 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.381913 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.382052 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.382177 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.382288 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.382491 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.382628 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.382826 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.382910 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.383134 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.383219 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.383440 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.383526 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.383753 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.383840 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.384144 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.384266 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.384500 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.384584 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.384865 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.384947 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.385201 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.385285 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.385513 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.385599 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.385833 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.385917 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.386149 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.386235 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.386459 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.386565 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.386795 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.386878 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.387104 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.387199 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.387411 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.387504 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.387722 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.387808 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.388042 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.388136 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.388379 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.388629 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.388724 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.388961 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.389047 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.389277 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.389364 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.389594 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.389678 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.389906 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.389998 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.390220 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.390306 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.390551 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.390641 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.390887 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.390984 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.391200 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.391285 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.391505 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.391597 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.391822 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.391917 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.392152 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.392350 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.392537 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.392689 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.392845 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.392997 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.393136 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.393273 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.393417 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.393564 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.393701 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.393848 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.393985 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.394121 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.394297 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.394447 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.394621 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.394772 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.394918 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.395055 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.395191 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.395338 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.395486 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.395623 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.395769 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.395907 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.396044 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.396187 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.396323 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.396468 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.396616 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.396753 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.396898 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.397038 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.397185 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.397453 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.397597 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.397741 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.397878 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.398084 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.398263 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.398417 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.398630 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.398782 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.398921 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.399058 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.399206 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.399377 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.399522 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.399767 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.399914 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.400169 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.400322 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.400507 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.400650 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.400799 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.400959 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.401104 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.401254 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.401393 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.401574 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.401718 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.401888 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.402032 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.402184 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.402331 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.402502 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.402683 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.402833 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.402978 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.403116 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.403261 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.403433 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.403577 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.403750 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.403911 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.404051 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.404187 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.404351 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.404501 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.404648 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.404804 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.404951 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.405088 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.405308 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.405458 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.405595 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.405738 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.405885 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.406024 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.406191 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.406338 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.406475 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.406643 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.406809 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.406972 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.407118 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.407255 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.407399 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.407627 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.407778 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.407916 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.408060 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.408205 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.408345 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.408492 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.408650 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.408796 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.408961 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.409100 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.409235 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.409386 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.409526 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.409663 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.409799 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.409935 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.410079 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.410226 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.410372 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.410554 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.410711 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.410885 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.411024 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.411171 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.411309 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.411492 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.411631 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.411768 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.411919 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.412057 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.412201 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.412348 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.412497 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.412636 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.412804 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.412943 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.413086 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.413224 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.413360 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.413495 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.413644 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.413782 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.413925 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.414062 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.414199 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.414352 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.414504 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.414703 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.414851 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.414989 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.415132 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.415300 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.415445 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.415670 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.415917 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.416074 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.416212 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.416377 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.416516 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.416660 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.416822 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.416962 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.417105 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.417256 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.417418 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.417567 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.417789 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.417789 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.418066 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.418220 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.418378 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.418556 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.418711 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.418859 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.419006 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.419143 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.419279 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.419422 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.419560 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.419695 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.419840 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.419979 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.420122 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.420270 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.420415 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.420559 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.420706 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.420843 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.420979 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.421116 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.421254 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.421389 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.421534 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.421671 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.421808 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.421957 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.422109 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.422256 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.422400 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.422576 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.422723 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.422891 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.423045 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.423195 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.423333 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.423494 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.423644 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.423808 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.423961 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.424118 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.424256 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.424418 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.424569 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.424729 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.424874 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.425021 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.425158 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.425323 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.425476 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.425624 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.425770 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.425918 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.426055 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.426213 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.426357 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.426570 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.426736 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.426877 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.427012 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.427149 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.427291 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.427440 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.427587 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.427725 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.427962 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.428106 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.428243 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.428381 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.428527 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.428665 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.428801 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.428938 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.429074 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.429223 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.429396 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.429607 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.429811 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.429964 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.430195 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.430360 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.430535 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.430683 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.430859 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.431071 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.431210 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.431468 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.431615 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.431783 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.431930 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.432093 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.432251 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.432403 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.432540 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.432712 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.432855 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.433026 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.433167 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.433355 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.433499 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.433681 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.433832 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.434010 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.434178 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.434318 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.434460 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.434625 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.434765 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.434943 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.435105 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.435272 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.435414 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.435560 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.435697 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.435866 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.436020 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.436169 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.436305 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.436479 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.436624 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.436784 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.436939 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.437087 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.437223 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.437396 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.437547 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.437701 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.437842 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.438067 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.438229 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.438367 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.438576 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.438737 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.438878 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.439021 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.439167 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.439311 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.439449 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.439594 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.439731 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.439868 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.440017 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.440154 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.440300 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.440440 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.440610 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.440761 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.440927 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.441170 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.441327 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.441474 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.441611 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.441788 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.441932 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.442090 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.442238 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.442382 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.442551 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.442715 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.442869 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.443015 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.443169 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.443313 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.443456 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.443625 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.443781 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.444049 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.444221 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.444368 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.444518 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.444662 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.444805 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.444958 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.445102 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.445245 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.445388 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.445531 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.445674 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.445826 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.445970 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.446164 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.446315 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.446459 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.446660 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.446850 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.447123 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.447281 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.447425 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.447569 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.447726 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.447878 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.448022 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.448263 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.448414 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.448558 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.448710 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.448855 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.448997 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.449140 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.449290 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.449434 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.449587 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.449734 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.449883 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.450115 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.450282 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.450429 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.450620 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.450776 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.450930 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.451084 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.451231 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.451382 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.451528 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.451680 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.451834 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.451985 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.452131 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.452285 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.452285 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.452557 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.452729 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.452956 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.453120 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.453268 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.453486 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.453663 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.453817 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.454065 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.454216 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.454361 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.454571 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.454736 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.454881 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.455023 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.455166 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.455317 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.455461 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.455614 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.455767 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.455914 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.456057 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.456200 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.456365 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.456510 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.456654 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.456798 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.456941 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.457094 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.457252 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.457404 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.457548 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.457698 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.457844 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.457994 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.458148 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.458389 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.458562 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.458714 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.458859 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.459002 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.459157 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.459303 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.459446 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.459651 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.459807 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.459962 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.460106 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.460256 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.460418 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.460569 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.460723 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.460879 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.461024 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.461166 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.461318 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.461463 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.461606 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.461759 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.461904 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.462049 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.462263 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.462862 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.463024 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.463190 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.463337 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.463481 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.463632 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.463777 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.463930 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.464075 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.464219 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.464364 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.464507 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.464670 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.464824 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.464975 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.465127 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.465271 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.465415 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.465557 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.465710 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.465710 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.465989 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.466134 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.466284 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.466428 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.466656 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.466812 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.466957 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.467101 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.467246 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.467398 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.467549 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.467695 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.467840 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.467840 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.468109 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.468263 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.468425 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.468654 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.468803 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.468948 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.469099 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.469253 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.469397 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.469540 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.469683 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.469825 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.469967 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.470121 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.470273 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.470438 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.470620 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.470767 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.470927 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.471074 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.471219 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.471374 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.471518 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.471670 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.471827 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.471973 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.472116 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.472267 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.472423 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.472567 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.472719 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.472871 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.473022 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.473173 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.473317 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.473470 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.473615 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.473758 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.473901 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.474059 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.474214 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.474366 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.474553 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.474706 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.474860 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.478775 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.478879 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.478978 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.479050 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.479050 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.479181 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.479247 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.479342 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.479425 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.479503 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.479580 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.479673 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.479741 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.479821 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.479901 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.479979 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.480064 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.480142 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.480227 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.480314 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.480394 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.480479 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.480558 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.480636 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.480713 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.480713 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.480867 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.480944 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.481022 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.481099 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.481184 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.481271 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.481351 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.481428 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.481513 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.481591 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.481677 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.481989 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.482120 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.482651 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.482797 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.483197 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.483356 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.483730 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.484017 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.484110 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.484232 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.484379 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.484611 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.484818 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.484948 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.485275 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.485404 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.485618 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.485824 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.485955 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.486303 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.486432 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.486645 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.486864 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.486963 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.487290 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.487378 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.487614 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.487844 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.487983 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.488311 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.488707 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.488947 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.489271 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.489374 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.489597 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.489917 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.490110 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.490228 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.490568 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.490683 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.490922 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.491218 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.491307 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.491536 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.491635 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.491849 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.491961 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.492158 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.492302 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.492495 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.492603 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.492805 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.492931 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.493145 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.493239 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.493648 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.493977 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.494169 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.494284 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.494371 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.494622 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.494729 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.494939 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.495026 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.495261 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.495538 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.495626 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.495863 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.495957 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.496177 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.496266 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.496489 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.496575 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.496828 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.496914 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.497140 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.497225 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.497450 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.497548 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.497762 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.497848 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.498077 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.498161 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.498385 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.498478 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.498719 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.498805 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.499030 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.499115 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.499337 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.499434 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.499654 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.499745 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.499961 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.500055 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.500267 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.500361 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.500577 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.500669 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.500894 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.500979 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.501199 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.501430 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.501517 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.501788 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.501876 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.502110 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.502394 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.502394 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.502591 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.502734 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.502823 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.503055 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.503167 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.503369 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.503456 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.503694 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.503793 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.504006 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.504099 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.504314 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.504406 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.504637 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.504722 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.504952 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.505046 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.505261 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.505498 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.505586 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.505869 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.505967 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.506185 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.506286 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.506493 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.506632 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.506831 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.506927 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.507139 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.507225 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.507468 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.507554 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.507777 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.507870 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.508085 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.508171 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.508398 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.508489 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.508706 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.508798 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.509180 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.509425 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.509425 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.509671 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.509962 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.510055 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.510275 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.510360 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.510611 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.510718 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.510925 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.511012 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.511236 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.511352 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.511556 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.511647 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.511871 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.511958 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.512188 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.512273 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.512497 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.512583 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.512812 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.512898 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.513126 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.513235 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.513436 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.513542 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.513748 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.513841 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.514057 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.514142 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.514369 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.514468 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.514711 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.514798 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.515027 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.515111 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.515335 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.515437 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.515650 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.515757 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.515999 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.516086 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.516321 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.516408 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.516673 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.516860 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.516985 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.517251 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.517410 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.517578 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.517665 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.517911 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.517998 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.518236 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.518336 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.518570 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.518659 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.518883 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.518967 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.519199 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.519296 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.519527 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.519614 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.519844 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.519930 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.520153 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.520246 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.520459 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.520556 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.520770 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.520856 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.521082 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.521168 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.521397 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.521495 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.521717 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.521815 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.522030 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.522116 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.522348 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.522433 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.522676 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.522776 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.522998 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.523085 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.523308 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.523411 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.523628 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.523735 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.523956 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.524048 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.524269 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.524353 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.524580 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.524704 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.525109 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.525426 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.525511 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.525740 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.525840 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.526052 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.526140 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.526364 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.526450 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.526703 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.526803 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.527016 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.527102 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.527342 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.527426 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.527666 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.527764 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.527975 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.528069 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.528300 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.528386 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.528615 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.528705 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.528935 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.529021 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.529250 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.529337 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.529562 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.529656 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.529892 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.529980 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.530202 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.530289 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.530550 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.530641 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.530850 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.530947 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.531162 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.531249 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.531478 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.531566 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.531793 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.531879 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.532119 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.532219 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.532428 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.532530 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.532736 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.532822 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.533100 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.533204 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.533390 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.533501 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.533703 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.533799 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.534031 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.534126 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.534359 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.534458 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.534696 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.534784 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.535011 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.535098 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.535318 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.535404 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.535562 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 23 11:50:13.535648 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.535949 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.536267 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.536579 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.536911 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.537224 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.537540 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.537853 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.538164 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.538479 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.538817 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.539142 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.539474 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.539786 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.540113 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.540626 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.541027 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.541346 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.541661 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.541997 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.542313 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.542665 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.542981 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.543330 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.543738 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.543929 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.544260 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.544587 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.544915 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.545243 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.545591 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.545905 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.546252 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.546607 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.546928 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.547242 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.547550 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:50:13.547795 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 23 11:50:13.558744 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_db.sqlalchemy.engines [None req-c63b9aaa-d4f4-4b9d-aab9-a0c0d35ca3e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:50:13.570746 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG oslo_db.sqlalchemy.engines [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:50:13.625076 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.context [None req-c63b9aaa-d4f4-4b9d-aab9-a0c0d35ca3e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f84be753-2dc6-40a4-9555-fbe0caef5ac0(cell1) {{(pid=101765) load_cells /opt/stack/nova/nova/context.py:464}} Dec 23 11:50:13.629354 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-c63b9aaa-d4f4-4b9d-aab9-a0c0d35ca3e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:50:13.631059 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-c63b9aaa-d4f4-4b9d-aab9-a0c0d35ca3e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:50:13.631844 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-c63b9aaa-d4f4-4b9d-aab9-a0c0d35ca3e3 None None] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:50:13.633816 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-c63b9aaa-d4f4-4b9d-aab9-a0c0d35ca3e3 None None] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:50:13.638432 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.context [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f84be753-2dc6-40a4-9555-fbe0caef5ac0(cell1) {{(pid=101764) load_cells /opt/stack/nova/nova/context.py:464}} Dec 23 11:50:13.642726 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG oslo_concurrency.lockutils [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:50:13.644356 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG oslo_concurrency.lockutils [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:50:13.645178 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG oslo_concurrency.lockutils [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:50:13.646761 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_db.sqlalchemy.engines [None req-c63b9aaa-d4f4-4b9d-aab9-a0c0d35ca3e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:50:13.647231 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG oslo_concurrency.lockutils [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:50:13.647578 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_db.sqlalchemy.engines [None req-c63b9aaa-d4f4-4b9d-aab9-a0c0d35ca3e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:50:13.660740 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG oslo_db.sqlalchemy.engines [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:50:13.663297 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG oslo_db.sqlalchemy.engines [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:50:13.819661 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_db.sqlalchemy.engines [None req-c63b9aaa-d4f4-4b9d-aab9-a0c0d35ca3e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:50:13.828668 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG oslo_db.sqlalchemy.engines [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:50:14.163949 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: WARNING keystonemiddleware.auth_token [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 23 11:50:14.166011 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: WARNING keystonemiddleware.auth_token [None req-c63b9aaa-d4f4-4b9d-aab9-a0c0d35ca3e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 23 11:50:14.170734 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: WARNING keystonemiddleware.auth_token [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 23 11:50:14.172687 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: WARNING keystonemiddleware.auth_token [None req-c63b9aaa-d4f4-4b9d-aab9-a0c0d35ca3e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 23 11:50:14.512660 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: WARNING keystonemiddleware.auth_token [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 23 11:50:14.517920 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: WARNING keystonemiddleware.auth_token [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 23 11:50:14.519444 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: WARNING keystonemiddleware.auth_token [None req-c63b9aaa-d4f4-4b9d-aab9-a0c0d35ca3e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 23 11:50:14.523120 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5625428b39c0 pid: 101764 (default app) Dec 23 11:50:14.524948 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: WARNING keystonemiddleware.auth_token [None req-c63b9aaa-d4f4-4b9d-aab9-a0c0d35ca3e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 23 11:50:14.525378 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:50:14.529261 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002005 Dec 23 11:50:14.529261 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Thu Dec 23 11:50:14 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:50:14.530900 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5625428b39c0 pid: 101765 (default app) Dec 23 11:51:43.543433 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:51:43.545109 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002192 Dec 23 11:51:43.545690 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 930 bytes} [Thu Dec 23 11:51:43 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:51:43.970208 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-959f834f-cbef-4191-9b82-61a302da7498 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:51:44.000022 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-959f834f-cbef-4191-9b82-61a302da7498 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.446846 Dec 23 11:51:44.000837 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1291 bytes} [Thu Dec 23 11:51:43 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:51:46.434826 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:51:46.435901 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-00fe7350-1dec-42f6-9bed-dffeb66bc22b None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Dec 23 11:51:46.436304 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 3/4] 10.222.0.65 () {54 vars in 930 bytes} [Thu Dec 23 11:51:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:51:46.500109 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-56aa6721-9c2a-45b3-ae3e-6b8f9bd932f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:51:46.519138 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:51:46.519138 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: warnings.warn(msg) Dec 23 11:51:46.547828 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-56aa6721-9c2a-45b3-ae3e-6b8f9bd932f7 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105126 Dec 23 11:51:46.548640 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 2/5] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Dec 23 11:51:46 2021] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:51:46.766548 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-007a2f22-842f-4916-9574-0f1356ffc76a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:51:46.768961 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:51:46.768961 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: warnings.warn(msg) Dec 23 11:51:46.821665 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-007a2f22-842f-4916-9574-0f1356ffc76a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.264082 Dec 23 11:51:46.831730 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 4/6] 10.222.0.65 () {64 vars in 1335 bytes} [Thu Dec 23 11:51:46 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:51:49.243189 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-56aa6721-9c2a-45b3-ae3e-6b8f9bd932f7 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:51:49.244790 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-56aa6721-9c2a-45b3-ae3e-6b8f9bd932f7 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002281 Dec 23 11:51:49.245442 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 3/7] 10.222.0.65 () {54 vars in 930 bytes} [Thu Dec 23 11:51:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:51:49.382113 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-f624fc28-1236-4799-ad44-4004c2ad50cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "disk": 5, "os-flavor-access:is_public": true}} {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:51:49.401142 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:51:49.401142 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: warnings.warn(msg) Dec 23 11:51:49.425134 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-f624fc28-1236-4799-ad44-4004c2ad50cc admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.172470 Dec 23 11:51:49.426256 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 5/8] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Dec 23 11:51:49 2021] POST /compute/v2.1/flavors => generated 404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:51:49.438739 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-659e0675-50aa-48ed-a770-d0fa1c2ce7d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:51:49.441272 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:51:49.441272 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: warnings.warn(msg) Dec 23 11:51:49.478883 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-659e0675-50aa-48ed-a770-d0fa1c2ce7d4 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044026 Dec 23 11:51:49.479846 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 4/9] 10.222.0.65 () {64 vars in 1335 bytes} [Thu Dec 23 11:51:49 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:51:51.865477 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-f624fc28-1236-4799-ad44-4004c2ad50cc admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:51:51.866549 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-f624fc28-1236-4799-ad44-4004c2ad50cc admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Dec 23 11:51:51.867135 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 930 bytes} [Thu Dec 23 11:51:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:51:51.943035 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-5d1f8e3a-15dd-4f18-9f79-abf768aa36b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "name": "ds1G", "id": "d2"}} {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:51:51.964128 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-5d1f8e3a-15dd-4f18-9f79-abf768aa36b1 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.090246 Dec 23 11:51:51.965066 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 5/11] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Dec 23 11:51:51 2021] POST /compute/v2.1/flavors => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 23 11:51:51.976990 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-63f4250c-cede-45d4-ad8b-e464a27296ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:51:52.000936 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-63f4250c-cede-45d4-ad8b-e464a27296ac admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027587 Dec 23 11:51:52.001630 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 7/12] 10.222.0.65 () {64 vars in 1335 bytes} [Thu Dec 23 11:51:51 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:51:54.413559 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-5d1f8e3a-15dd-4f18-9f79-abf768aa36b1 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:51:54.414863 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-5d1f8e3a-15dd-4f18-9f79-abf768aa36b1 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Dec 23 11:51:54.415615 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 6/13] 10.222.0.65 () {54 vars in 930 bytes} [Thu Dec 23 11:51:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:51:54.476402 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-dca78898-4653-4749-a269-ca28b607ca11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "id": "d3"}} {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:51:54.494830 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-dca78898-4653-4749-a269-ca28b607ca11 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072858 Dec 23 11:51:54.495388 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 8/14] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Dec 23 11:51:54 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:51:54.507546 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-189c1300-6c89-4cfd-a67a-b7b499edd72b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:51:54.530639 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-189c1300-6c89-4cfd-a67a-b7b499edd72b admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026699 Dec 23 11:51:54.531185 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 7/15] 10.222.0.65 () {64 vars in 1335 bytes} [Thu Dec 23 11:51:54 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:51:57.113319 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-dca78898-4653-4749-a269-ca28b607ca11 admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:51:57.114487 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-dca78898-4653-4749-a269-ca28b607ca11 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002006 Dec 23 11:51:57.115298 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 9/16] 10.222.0.65 () {54 vars in 930 bytes} [Thu Dec 23 11:51:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:51:57.180433 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-8c032dc0-d1d4-49b2-82a6-937f83a5ec0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:51:57.201871 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-8c032dc0-d1d4-49b2-82a6-937f83a5ec0a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079146 Dec 23 11:51:57.202679 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 8/17] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Dec 23 11:51:57 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:51:57.215460 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-14c0c8c9-ad31-455b-8530-9d545c5aab83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:51:57.247225 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-14c0c8c9-ad31-455b-8530-9d545c5aab83 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035121 Dec 23 11:51:57.248362 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 10/18] 10.222.0.65 () {64 vars in 1335 bytes} [Thu Dec 23 11:51:57 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:51:59.830406 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-8c032dc0-d1d4-49b2-82a6-937f83a5ec0a admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:51:59.831682 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-8c032dc0-d1d4-49b2-82a6-937f83a5ec0a admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001832 Dec 23 11:51:59.832215 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 9/19] 10.222.0.65 () {54 vars in 930 bytes} [Thu Dec 23 11:51:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 11:51:59.901558 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-a51301e4-6420-4321-bc13-083b8e25b2c2 admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:51:59.927260 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-a51301e4-6420-4321-bc13-083b8e25b2c2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086021 Dec 23 11:51:59.927909 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 11/20] 10.222.0.65 () {60 vars in 1291 bytes} [Thu Dec 23 11:51:59 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:52:02.531366 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-8c032dc0-d1d4-49b2-82a6-937f83a5ec0a admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:02.532487 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-8c032dc0-d1d4-49b2-82a6-937f83a5ec0a admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Dec 23 11:52:02.532898 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 930 bytes} [Thu Dec 23 11:52:02 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:52:02.599315 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-e1fcdf86-85bc-4963-b6db-c12498dca134 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:52:02.621619 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-e1fcdf86-85bc-4963-b6db-c12498dca134 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081805 Dec 23 11:52:02.622106 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 12/22] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Dec 23 11:52:02 2021] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:52:02.635159 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-7956c12f-b104-400a-9bc3-a028d3fe9b95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:52:02.667296 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-7956c12f-b104-400a-9bc3-a028d3fe9b95 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036093 Dec 23 11:52:02.667830 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 11/23] 10.222.0.65 () {64 vars in 1332 bytes} [Thu Dec 23 11:52:02 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:52:05.252720 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-e1fcdf86-85bc-4963-b6db-c12498dca134 admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:05.253793 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-e1fcdf86-85bc-4963-b6db-c12498dca134 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Dec 23 11:52:05.254390 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 930 bytes} [Thu Dec 23 11:52:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:52:05.321348 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-8aec082f-4674-4e92-9089-3312b15156dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:52:05.340614 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-8aec082f-4674-4e92-9089-3312b15156dd admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079346 Dec 23 11:52:05.341215 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 12/25] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Dec 23 11:52:05 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:52:05.354656 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-bf94b7ac-f2f8-40ab-8c4e-a0c473ce93ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:52:05.380749 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-bf94b7ac-f2f8-40ab-8c4e-a0c473ce93ac admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030129 Dec 23 11:52:05.381432 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 14/26] 10.222.0.65 () {64 vars in 1332 bytes} [Thu Dec 23 11:52:05 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:52:07.822560 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-8aec082f-4674-4e92-9089-3312b15156dd admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:07.824136 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-8aec082f-4674-4e92-9089-3312b15156dd admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Dec 23 11:52:07.824507 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 930 bytes} [Thu Dec 23 11:52:07 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:52:07.889694 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-afdc8599-c450-44dc-aa04-b1e0a46883eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "3", "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:52:07.909659 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-afdc8599-c450-44dc-aa04-b1e0a46883eb admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.078600 Dec 23 11:52:07.910216 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 15/28] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Dec 23 11:52:07 2021] POST /compute/v2.1/flavors => generated 406 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:52:07.923003 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-f73ac290-8e8c-4ff7-9766-b28901758509 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:52:07.949805 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-f73ac290-8e8c-4ff7-9766-b28901758509 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030646 Dec 23 11:52:07.950390 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 14/29] 10.222.0.65 () {64 vars in 1332 bytes} [Thu Dec 23 11:52:07 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:52:10.446962 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-afdc8599-c450-44dc-aa04-b1e0a46883eb admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:10.447974 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-afdc8599-c450-44dc-aa04-b1e0a46883eb admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Dec 23 11:52:10.448680 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 16/30] 10.222.0.65 () {54 vars in 930 bytes} [Thu Dec 23 11:52:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:52:10.515319 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-6eb1c435-527a-47c1-828c-4802e3c9e4c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "name": "m1.large", "swap": 0, "ram": 8192, "id": "4", "vcpus": 4}} {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:52:10.534017 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-6eb1c435-527a-47c1-828c-4802e3c9e4c1 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078518 Dec 23 11:52:10.534931 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 15/31] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Dec 23 11:52:10 2021] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:52:10.546848 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-508e0e4f-eb92-49e6-a31e-a4b4a6a9a6bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:52:10.570147 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-508e0e4f-eb92-49e6-a31e-a4b4a6a9a6bb admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026995 Dec 23 11:52:10.571590 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 17/32] 10.222.0.65 () {64 vars in 1332 bytes} [Thu Dec 23 11:52:10 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:52:13.169281 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-6eb1c435-527a-47c1-828c-4802e3c9e4c1 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:13.170322 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-6eb1c435-527a-47c1-828c-4802e3c9e4c1 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Dec 23 11:52:13.170775 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 16/33] 10.222.0.65 () {54 vars in 930 bytes} [Thu Dec 23 11:52:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:52:13.244536 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-f6963771-5c26-4a90-bcf4-c53dcbb572af admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 16384, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:52:13.267639 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-f6963771-5c26-4a90-bcf4-c53dcbb572af admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.088707 Dec 23 11:52:13.269507 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 18/34] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Dec 23 11:52:13 2021] POST /compute/v2.1/flavors => generated 408 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:52:13.282267 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-6673491b-160a-4167-bb60-7a4332601189 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:52:13.306823 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-6673491b-160a-4167-bb60-7a4332601189 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028213 Dec 23 11:52:13.307405 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1332 bytes} [Thu Dec 23 11:52:13 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:52:35.205889 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-f6963771-5c26-4a90-bcf4-c53dcbb572af admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:35.206857 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-f6963771-5c26-4a90-bcf4-c53dcbb572af admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Dec 23 11:52:35.207254 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 930 bytes} [Thu Dec 23 11:52:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:52:35.276254 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-bd2cef4a-aaee-4c03-86c3-6bb11f930fbe admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:35.293235 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-bd2cef4a-aaee-4c03-86c3-6bb11f930fbe admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.079190 Dec 23 11:52:35.293773 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1291 bytes} [Thu Dec 23 11:52:35 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:52:36.883560 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-f6963771-5c26-4a90-bcf4-c53dcbb572af admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:36.884625 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-f6963771-5c26-4a90-bcf4-c53dcbb572af admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Dec 23 11:52:36.885024 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Dec 23 11:52:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:52:37.082853 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-e8e90e91-8f08-4f5b-a709-4ec05d5c392b admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:37.088807 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.wsgi [None req-e8e90e91-8f08-4f5b-a709-4ec05d5c392b admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 23 11:52:37.089338 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-e8e90e91-8f08-4f5b-a709-4ec05d5c392b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:52:37.090129 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-e8e90e91-8f08-4f5b-a709-4ec05d5c392b admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.069154 Dec 23 11:52:37.090666 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1190 bytes} [Thu Dec 23 11:52:37 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:37.100792 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-44b4fd6a-367b-4685-a468-4d3c0a0c628e admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:37.121409 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-44b4fd6a-367b-4685-a468-4d3c0a0c628e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024150 Dec 23 11:52:37.121949 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 21/40] 10.222.0.65 () {60 vars in 1210 bytes} [Thu Dec 23 11:52:37 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:52:37.132464 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-b66fa3ba-27a5-40ba-bdf8-615cfb80664a admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:37.153588 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-b66fa3ba-27a5-40ba-bdf8-615cfb80664a admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024727 Dec 23 11:52:37.154134 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1210 bytes} [Thu Dec 23 11:52:37 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:52:37.166114 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-2d023633-f8c4-4a13-9779-4fcf5a5210eb admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:37.171940 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.wsgi [None req-2d023633-f8c4-4a13-9779-4fcf5a5210eb admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 23 11:52:37.172480 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-2d023633-f8c4-4a13-9779-4fcf5a5210eb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:52:37.173265 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-2d023633-f8c4-4a13-9779-4fcf5a5210eb admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.012055 Dec 23 11:52:37.173757 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1190 bytes} [Thu Dec 23 11:52:37 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:38.639427 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-b66fa3ba-27a5-40ba-bdf8-615cfb80664a admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:38.640427 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-b66fa3ba-27a5-40ba-bdf8-615cfb80664a admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Dec 23 11:52:38.640818 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 21/43] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Dec 23 11:52:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:52:38.849805 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-5b9bb83b-cb8d-4f7d-a591-c5cb9f23bd1d admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:38.855375 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.wsgi [None req-5b9bb83b-cb8d-4f7d-a591-c5cb9f23bd1d admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 23 11:52:38.855933 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-5b9bb83b-cb8d-4f7d-a591-c5cb9f23bd1d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:52:38.856724 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-5b9bb83b-cb8d-4f7d-a591-c5cb9f23bd1d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.070638 Dec 23 11:52:38.857232 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 23/44] 10.222.0.65 () {60 vars in 1190 bytes} [Thu Dec 23 11:52:38 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:38.867788 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-4bbc4c2a-c20a-472a-98cc-f6965a994458 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:38.882056 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-4bbc4c2a-c20a-472a-98cc-f6965a994458 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018070 Dec 23 11:52:38.883262 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 22/45] 10.222.0.65 () {60 vars in 1210 bytes} [Thu Dec 23 11:52:38 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:52:38.898879 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-d742be9e-3850-46de-8bd7-ce75e0e82b18 admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:38.912772 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-d742be9e-3850-46de-8bd7-ce75e0e82b18 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019830 Dec 23 11:52:38.913463 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 24/46] 10.222.0.65 () {60 vars in 1210 bytes} [Thu Dec 23 11:52:38 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:52:38.925371 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-f6a0eda0-86b1-4015-a962-2acb13b7d021 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:38.932796 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.wsgi [None req-f6a0eda0-86b1-4015-a962-2acb13b7d021 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 23 11:52:38.933354 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-f6a0eda0-86b1-4015-a962-2acb13b7d021 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:52:38.934130 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-f6a0eda0-86b1-4015-a962-2acb13b7d021 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014088 Dec 23 11:52:38.934648 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 23/47] 10.222.0.65 () {60 vars in 1190 bytes} [Thu Dec 23 11:52:38 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:40.421590 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-d742be9e-3850-46de-8bd7-ce75e0e82b18 admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:40.422642 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-d742be9e-3850-46de-8bd7-ce75e0e82b18 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Dec 23 11:52:40.423037 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 25/48] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Dec 23 11:52:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:52:40.625237 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-8700f3d3-8e4d-4db7-9b2b-da99b804c844 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:40.630859 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.wsgi [None req-8700f3d3-8e4d-4db7-9b2b-da99b804c844 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 23 11:52:40.631425 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-8700f3d3-8e4d-4db7-9b2b-da99b804c844 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101765) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:52:40.632289 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-8700f3d3-8e4d-4db7-9b2b-da99b804c844 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.074026 Dec 23 11:52:40.632971 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 24/49] 10.222.0.65 () {60 vars in 1193 bytes} [Thu Dec 23 11:52:40 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:40.642938 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-4b6f8038-1b0e-487c-8728-a11a63b039ab admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:40.656996 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-4b6f8038-1b0e-487c-8728-a11a63b039ab admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017591 Dec 23 11:52:40.657538 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 26/50] 10.222.0.65 () {60 vars in 1210 bytes} [Thu Dec 23 11:52:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:52:40.669511 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-c07b77ab-869c-4405-9250-ae35688fdae2 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:40.683007 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-c07b77ab-869c-4405-9250-ae35688fdae2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018632 Dec 23 11:52:40.683554 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 25/51] 10.222.0.65 () {60 vars in 1210 bytes} [Thu Dec 23 11:52:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:52:40.696903 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-5ca70b2a-f34a-4682-9664-5e9dea5fd256 admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:40.705745 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.wsgi [None req-5ca70b2a-f34a-4682-9664-5e9dea5fd256 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 23 11:52:40.706730 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-5ca70b2a-f34a-4682-9664-5e9dea5fd256 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:52:40.707997 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-5ca70b2a-f34a-4682-9664-5e9dea5fd256 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.017276 Dec 23 11:52:40.708850 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1193 bytes} [Thu Dec 23 11:52:40 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:42.191337 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-c07b77ab-869c-4405-9250-ae35688fdae2 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:42.192375 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-c07b77ab-869c-4405-9250-ae35688fdae2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Dec 23 11:52:42.192774 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Dec 23 11:52:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:52:42.395795 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-ebb08b82-b68e-4308-96f0-179de6c1ff47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:52:42.423328 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-ebb08b82-b68e-4308-96f0-179de6c1ff47 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.093812 Dec 23 11:52:42.424052 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 28/54] 10.222.0.65 () {64 vars in 1235 bytes} [Thu Dec 23 11:52:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:52:43.908137 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-c07b77ab-869c-4405-9250-ae35688fdae2 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:43.909139 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-c07b77ab-869c-4405-9250-ae35688fdae2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Dec 23 11:52:43.909542 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Dec 23 11:52:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 11:52:44.114498 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-5bf052ea-8d8c-40fe-b359-f88dd8b67d38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:52:44.135902 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-5bf052ea-8d8c-40fe-b359-f88dd8b67d38 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.087229 Dec 23 11:52:44.136441 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 29/56] 10.222.0.65 () {64 vars in 1235 bytes} [Thu Dec 23 11:52:44 2021] POST /compute/v2.1/flavors => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:52:45.634469 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-c07b77ab-869c-4405-9250-ae35688fdae2 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:45.635505 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-c07b77ab-869c-4405-9250-ae35688fdae2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Dec 23 11:52:45.635902 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 28/57] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Dec 23 11:52:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:52:45.841094 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-439b5fc0-2e1e-4f03-8400-61eaaa3c104b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:52:45.863003 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-439b5fc0-2e1e-4f03-8400-61eaaa3c104b admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.086893 Dec 23 11:52:45.863565 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 30/58] 10.222.0.65 () {64 vars in 1235 bytes} [Thu Dec 23 11:52:45 2021] POST /compute/v2.1/flavors => generated 407 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:52:47.337614 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-c07b77ab-869c-4405-9250-ae35688fdae2 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:47.338966 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-c07b77ab-869c-4405-9250-ae35688fdae2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001864 Dec 23 11:52:47.339440 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 29/59] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Dec 23 11:52:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:52:47.532562 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-3fd6a2a9-c70e-48f4-ae0f-310da226d242 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:52:47.553286 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-3fd6a2a9-c70e-48f4-ae0f-310da226d242 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.075159 Dec 23 11:52:47.553778 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 31/60] 10.222.0.65 () {64 vars in 1235 bytes} [Thu Dec 23 11:52:47 2021] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:52:49.052855 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-c07b77ab-869c-4405-9250-ae35688fdae2 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:49.053911 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-c07b77ab-869c-4405-9250-ae35688fdae2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Dec 23 11:52:49.054470 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 30/61] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Dec 23 11:52:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:52:49.257936 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-4b3e7b04-9e7a-4adf-a682-8c1539c9a175 admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:52:49.277347 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-4b3e7b04-9e7a-4adf-a682-8c1539c9a175 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.083683 Dec 23 11:52:49.277901 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 32/62] 10.222.0.65 () {60 vars in 1202 bytes} [Thu Dec 23 11:52:49 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:53:37.122418 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-c07b77ab-869c-4405-9250-ae35688fdae2 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:53:37.123524 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-c07b77ab-869c-4405-9250-ae35688fdae2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Dec 23 11:53:37.123902 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 930 bytes} [Thu Dec 23 11:53:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:53:37.195162 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-3b7e1950-4588-464d-abcd-16c6c34442af admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:53:37.214102 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-3b7e1950-4588-464d-abcd-16c6c34442af admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.083532 Dec 23 11:53:37.214666 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 33/64] 10.222.0.65 () {60 vars in 1291 bytes} [Thu Dec 23 11:53:37 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:53:37.236613 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-0ea58ee5-bf03-47a5-98ed-5f56cd0d7fca admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:53:37.245094 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-0ea58ee5-bf03-47a5-98ed-5f56cd0d7fca admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012067 Dec 23 11:53:37.245548 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 32/65] 10.222.0.65 () {60 vars in 1282 bytes} [Thu Dec 23 11:53:37 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:53:37.257483 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-71eded18-db7f-47ac-8893-fe7c65932fbf admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:53:37.265281 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-71eded18-db7f-47ac-8893-fe7c65932fbf admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011487 Dec 23 11:53:37.265800 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 34/66] 10.222.0.65 () {60 vars in 1285 bytes} [Thu Dec 23 11:53:37 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:53:37.284103 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-cf2e515f-6651-4d0c-9eb4-7b3fe917d0c5 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:53:37.293501 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-cf2e515f-6651-4d0c-9eb4-7b3fe917d0c5 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014947 Dec 23 11:53:37.294014 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 33/67] 10.222.0.65 () {60 vars in 1285 bytes} [Thu Dec 23 11:53:37 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:53:37.305702 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-7f68c03b-7660-4d5c-9470-8db5fa99e70a admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:53:37.313748 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-7f68c03b-7660-4d5c-9470-8db5fa99e70a admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011683 Dec 23 11:53:37.314262 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 35/68] 10.222.0.65 () {60 vars in 1282 bytes} [Thu Dec 23 11:53:37 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:55:01.790706 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-75fb40a3-a3c5-4049-a355-ac7cd30f3f46 tempest-verify_tempest_config-705206512 tempest-verify_tempest_config-705206512-project] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:55:01.792748 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-75fb40a3-a3c5-4049-a355-ac7cd30f3f46 tempest-verify_tempest_config-705206512 tempest-verify_tempest_config-705206512-project] 10.222.0.65 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.146300 Dec 23 11:55:01.793280 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 34/69] 10.222.0.65 () {58 vars in 1133 bytes} [Thu Dec 23 11:55:01 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:56:33.739056 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-7f68c03b-7660-4d5c-9470-8db5fa99e70a admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:56:33.740427 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-7f68c03b-7660-4d5c-9470-8db5fa99e70a admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Dec 23 11:56:33.740555 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 36/70] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Dec 23 11:56:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:56:34.009099 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-54642959-f62b-4314-91fc-aa45f34efe7d admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:56:34.010258 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:56:34.010258 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: warnings.warn(msg) Dec 23 11:56:34.012010 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-54642959-f62b-4314-91fc-aa45f34efe7d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:56:34.012513 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-54642959-f62b-4314-91fc-aa45f34efe7d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:56:34.013388 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-54642959-f62b-4314-91fc-aa45f34efe7d admin admin] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:56:34.013818 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-54642959-f62b-4314-91fc-aa45f34efe7d admin admin] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:56:34.046844 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-54642959-f62b-4314-91fc-aa45f34efe7d admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.167381 Dec 23 11:56:34.047403 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 35/71] 10.222.0.65 () {60 vars in 1193 bytes} [Thu Dec 23 11:56:33 2021] GET /compute/v2.1/os-services => generated 791 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:56:35.553803 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-7f68c03b-7660-4d5c-9470-8db5fa99e70a admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:56:35.554860 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-7f68c03b-7660-4d5c-9470-8db5fa99e70a admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Dec 23 11:56:35.555257 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 37/72] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Dec 23 11:56:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:56:35.751625 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-640f9a4c-fd1b-44e9-ac5b-4df858b28524 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:56:35.752806 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:56:35.752806 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: warnings.warn(msg) Dec 23 11:56:35.754369 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-640f9a4c-fd1b-44e9-ac5b-4df858b28524 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:56:35.754873 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-640f9a4c-fd1b-44e9-ac5b-4df858b28524 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:56:35.755927 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-640f9a4c-fd1b-44e9-ac5b-4df858b28524 admin admin] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:56:35.756365 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-640f9a4c-fd1b-44e9-ac5b-4df858b28524 admin admin] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:56:35.775747 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-640f9a4c-fd1b-44e9-ac5b-4df858b28524 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079256 Dec 23 11:56:35.776315 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 36/73] 10.222.0.65 () {60 vars in 1193 bytes} [Thu Dec 23 11:56:35 2021] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:56:47.692088 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-7f68c03b-7660-4d5c-9470-8db5fa99e70a admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:56:47.692716 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-7f68c03b-7660-4d5c-9470-8db5fa99e70a admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Dec 23 11:56:47.693445 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 38/74] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Dec 23 11:56:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:56:47.893534 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-84b2262f-69df-4511-9a8f-7a90e3adad45 admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:56:47.894767 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:56:47.894767 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: warnings.warn(msg) Dec 23 11:56:47.896318 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-84b2262f-69df-4511-9a8f-7a90e3adad45 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:56:47.896751 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-84b2262f-69df-4511-9a8f-7a90e3adad45 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:56:47.897529 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-84b2262f-69df-4511-9a8f-7a90e3adad45 admin admin] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:56:47.897950 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-84b2262f-69df-4511-9a8f-7a90e3adad45 admin admin] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:56:47.921851 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-84b2262f-69df-4511-9a8f-7a90e3adad45 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087016 Dec 23 11:56:47.922463 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 37/75] 10.222.0.65 () {60 vars in 1193 bytes} [Thu Dec 23 11:56:47 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:56:49.425631 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: DEBUG nova.api.openstack.wsgi [None req-7f68c03b-7660-4d5c-9470-8db5fa99e70a admin admin] Calling method '>' {{(pid=101764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:56:49.426726 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: INFO nova.api.openstack.requestlog [None req-7f68c03b-7660-4d5c-9470-8db5fa99e70a admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Dec 23 11:56:49.427164 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: [pid: 101764|app: 0|req: 39/76] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Dec 23 11:56:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:56:49.623674 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG nova.api.openstack.wsgi [None req-1625df94-e2ca-4dd2-95db-42d42b5babcf admin admin] Calling method '>' {{(pid=101765) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:56:49.624777 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:56:49.624777 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: warnings.warn(msg) Dec 23 11:56:49.626310 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-1625df94-e2ca-4dd2-95db-42d42b5babcf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:56:49.626788 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-1625df94-e2ca-4dd2-95db-42d42b5babcf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:56:49.627581 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-1625df94-e2ca-4dd2-95db-42d42b5babcf admin admin] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:56:49.628022 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: DEBUG oslo_concurrency.lockutils [None req-1625df94-e2ca-4dd2-95db-42d42b5babcf admin admin] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:56:49.648912 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: INFO nova.api.openstack.requestlog [None req-1625df94-e2ca-4dd2-95db-42d42b5babcf admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080683 Dec 23 11:56:49.649453 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: [pid: 101765|app: 0|req: 38/77] 10.222.0.65 () {60 vars in 1193 bytes} [Thu Dec 23 11:56:49 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:57:49.079514 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: Thu Dec 23 11:57:49 2021 - graceful shutdown triggered... Dec 23 11:57:49.079242 dv-cinder-822821-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 23 11:57:49.080464 dv-cinder-822821-1-iscsi devstack@n-api.service[101764]: Gracefully killing worker 1 (pid: 101764)... Dec 23 11:57:49.080829 dv-cinder-822821-1-iscsi devstack@n-api.service[101765]: Gracefully killing worker 2 (pid: 101765)... Dec 23 11:57:50.079477 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: worker 1 buried after 1 seconds Dec 23 11:57:50.079477 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: worker 2 buried after 1 seconds Dec 23 11:57:50.079477 dv-cinder-822821-1-iscsi devstack@n-api.service[101763]: goodbye to uWSGI. Dec 23 11:57:50.082005 dv-cinder-822821-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 23 11:57:50.083002 dv-cinder-822821-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 23 11:57:50.087575 dv-cinder-822821-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 23 11:57:50.100924 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 23 11:57:50.103653 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Dec 23 11:57:50 2021] *** Dec 23 11:57:50.103653 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 23 11:57:50.103653 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 23 11:57:50.103653 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: nodename: dv-cinder-822821-1-iscsi Dec 23 11:57:50.103653 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: machine: x86_64 Dec 23 11:57:50.103653 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: clock source: unix Dec 23 11:57:50.103653 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: pcre jit disabled Dec 23 11:57:50.103653 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: detected number of CPU cores: 4 Dec 23 11:57:50.103653 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: current working directory: / Dec 23 11:57:50.103653 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: detected binary path: /usr/bin/uwsgi-core Dec 23 11:57:50.103653 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: your processes number limit is 47680 Dec 23 11:57:50.103653 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: your memory page size is 4096 bytes Dec 23 11:57:50.103653 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: detected max file descriptor number: 2048 Dec 23 11:57:50.103653 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: lock engine: pthread robust mutexes Dec 23 11:57:50.104708 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: thunder lock: enabled Dec 23 11:57:50.104708 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 23 11:57:50.104708 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 23 11:57:50.149808 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: Python main interpreter initialized at 0x55caed87c9c0 Dec 23 11:57:50.149808 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: python threads support enabled Dec 23 11:57:50.149808 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: your server socket listen backlog is limited to 100 connections Dec 23 11:57:50.149808 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: your mercy for graceful operations on workers is 90 seconds Dec 23 11:57:50.150269 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: mapped 403077 bytes (393 KB) for 2 cores Dec 23 11:57:50.150269 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: *** Operational MODE: preforking *** Dec 23 11:57:50.150526 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: *** uWSGI is running in multiple interpreter mode *** Dec 23 11:57:50.150526 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: spawned uWSGI master process (pid: 116340) Dec 23 11:57:50.150806 dv-cinder-822821-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 23 11:57:50.151488 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: spawned uWSGI worker 1 (pid: 116354, cores: 1) Dec 23 11:57:50.151696 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: spawned uWSGI worker 2 (pid: 116355, cores: 1) Dec 23 11:57:50.153562 dv-cinder-822821-1-iscsi devstack@n-api.service[116340]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 23 11:57:52.035597 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 23 11:57:52.035597 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: from cryptography.utils import int_from_bytes Dec 23 11:57:52.036361 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 23 11:57:52.036361 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: from cryptography.utils import int_from_bytes Dec 23 11:57:52.053783 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 23 11:57:52.053783 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: from cryptography.utils import int_from_bytes Dec 23 11:57:52.054433 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 23 11:57:52.054433 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: from cryptography.utils import int_from_bytes Dec 23 11:57:54.430501 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 23 11:57:54.431161 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 23 11:57:54.431268 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 23 11:57:54.431621 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 23 11:57:54.431880 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 23 11:57:54.432278 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.432605 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.432929 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.433251 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.433583 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.433896 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.434222 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.434554 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.434887 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.435148 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.435466 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.435830 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822821-1-iscsi {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.436170 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.436481 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.436797 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.437115 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.437410 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.437749 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.438057 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.438713 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.439345 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.439886 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.440461 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.440778 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.441121 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.441420 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.441750 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.442064 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.442552 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.443016 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.443568 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822821-1-iscsi {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.444044 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.444509 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.445026 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.445442 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.445758 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.446088 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.446406 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.446773 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.447089 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.447427 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.447752 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.448075 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.448401 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.448707 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.449020 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.449333 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.449655 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.449962 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.450279 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.450545 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.450864 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.451190 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.451548 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.451867 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.452114 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.452371 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.452691 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.453018 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.453333 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.453644 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.453955 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.454264 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.454596 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.454911 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.455224 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.455536 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.455859 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.456182 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.456508 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.456822 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.457146 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.457545 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.457799 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.458111 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.458453 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.458799 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.459108 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.459434 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.459758 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.460075 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.460386 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.460694 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.461016 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.461349 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.461662 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.461916 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.462219 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.462565 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.463022 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.463189 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.463499 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.463998 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.464311 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.464625 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.464732 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 23 11:57:54.465152 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.465240 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 23 11:57:54.465323 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.465523 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 23 11:57:54.465648 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.465833 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.465930 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 23 11:57:54.466100 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 23 11:57:54.466224 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.466448 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.466586 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.466784 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.470758 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.470897 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.471038 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.471159 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.471279 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.471397 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.471514 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.471631 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.471755 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.471870 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.471985 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.472092 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.472208 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.472328 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.472444 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.472554 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.472674 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.472811 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.472930 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.473040 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.473153 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822821-1-iscsi {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.473277 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.473397 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.473506 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.473613 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.473726 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.473848 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.473963 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.474085 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.474203 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.474310 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.474416 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.474540 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.474670 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.474788 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.474907 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.474907 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.475118 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.475472 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.475622 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.475738 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.475854 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.475961 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.476092 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.476211 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.476327 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.476449 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.476571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.476695 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.476858 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.478022 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.478187 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.478343 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.478485 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.478668 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.478819 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.478975 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.479126 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.479275 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.479420 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822821-1-iscsi {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.479581 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.479730 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.479879 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.480028 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.480176 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.480321 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.480466 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.480466 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.480749 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.480890 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.481038 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.481179 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.481331 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.481482 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.481627 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.481767 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.481912 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.481912 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.482198 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.482198 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.482479 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.482709 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.482910 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.483062 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.483212 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.483372 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.483519 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.483519 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.483798 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.483948 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.484095 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.484235 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.484379 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.484518 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.484663 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.484812 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.484956 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.485095 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.485244 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.485591 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.485738 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.485910 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.486144 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.486299 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.486446 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.486640 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.486781 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.486939 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.486939 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.487680 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.487833 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.487998 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.488323 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.488479 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.488625 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.488767 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.488906 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.489052 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.489205 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.489347 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.489486 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.489625 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.489781 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.489929 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.490120 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.490270 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.490417 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.490575 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.490734 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.490889 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.491029 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.491167 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.491316 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.491456 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.491593 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.491762 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.491911 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.492056 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.492286 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.492470 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.492653 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.492841 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.493021 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.493203 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.493376 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.493549 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.493721 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.493913 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.494105 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.494288 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.494475 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.494743 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.494911 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.495053 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.495199 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.495357 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.495712 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.495863 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.496021 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.496163 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.496321 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.496468 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.496615 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.496765 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.496917 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.497064 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.497203 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.497342 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.497618 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.497776 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.497925 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.498077 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.498454 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.498730 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.498887 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.499041 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.499192 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.499340 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.499484 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.499630 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.499776 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.499935 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.500076 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.500076 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.500346 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.500346 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.500632 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.500632 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.500918 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.501058 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.501204 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.501344 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.501492 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.501640 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.501780 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.501920 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.502059 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.502198 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.502354 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.502494 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.502657 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.502807 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.502957 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.503107 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.503248 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.503399 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.503546 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.503694 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.503842 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.503988 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.504128 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.504292 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.504432 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.504570 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.504715 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.504937 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.505091 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.505241 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.505380 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.505526 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.505986 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.506197 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.506352 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.506493 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.506685 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.506825 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.506984 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.507125 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.507265 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.507403 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.507541 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.507833 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.507990 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.508139 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.508282 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.508450 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.508755 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.508935 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.509084 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.509232 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.509380 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.509519 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.509658 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.509805 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.509946 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.510091 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.510231 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.510371 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.510536 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.510705 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.510890 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.511043 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.511191 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.511333 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.511485 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.511631 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.511770 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.511917 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.512065 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.512205 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.512353 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.512494 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.512642 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.512788 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.512935 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.513075 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.513226 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.513374 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.513514 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.513652 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:57:54.513824 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.513985 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.514126 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.514271 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.514411 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.514578 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.514743 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.514896 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.515053 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.515195 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.515348 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.515495 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.515649 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.515822 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.516159 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.516301 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.516449 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.516591 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.516750 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.516889 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.517035 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.517174 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.517320 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.517466 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.517615 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.517890 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.518110 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.518259 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.518398 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.518572 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.518934 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.518934 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.519217 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.519365 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.519505 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.519644 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.519798 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.519946 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.520086 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.520224 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.520362 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.520501 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.520653 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.520805 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.520943 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.521094 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.521238 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.521420 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.521583 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.521725 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.521864 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.522003 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.522003 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.522276 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.522416 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.522571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.522736 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.522880 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.523018 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.523165 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.523304 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.523451 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.523591 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.523729 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.523866 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.524051 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.524191 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.524328 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.524476 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.524653 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.524819 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.524960 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.525099 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.525237 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.525374 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.525521 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.525669 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.525808 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.526156 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.526316 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.526457 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.526640 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.526791 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.526939 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.527079 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.527225 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.527373 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.527530 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.528081 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.528238 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.528387 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.528527 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.528665 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.528822 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.529159 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.529316 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.529549 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.529708 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.529857 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.530006 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.530154 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.530294 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.530439 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.530652 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.530796 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.531019 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.531168 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.531326 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.531526 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.531686 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.531826 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.531980 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.532120 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.532258 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.532397 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.532541 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.532701 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.532841 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.532987 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.533133 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.533285 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.533425 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.533571 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.533718 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.533863 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.534035 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.534186 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.534333 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.534482 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.535608 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.535768 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.535911 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.536090 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.536431 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.536591 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.536740 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.536881 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.536881 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.537205 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.537365 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.537513 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.537661 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.537800 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.537939 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.538233 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.538406 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.538574 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.538729 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.538868 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.539006 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.539892 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.540055 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.540198 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.540338 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.540486 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.540633 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.540781 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.540930 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.541089 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.541238 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.541378 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.541532 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.541687 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.541835 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.541974 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.542112 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.542256 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.542256 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.542545 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.542693 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.542833 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.542993 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.543136 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.543274 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.543426 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.543578 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.543724 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.543945 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.544086 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.544226 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.544226 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.544530 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.544530 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.544908 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.544908 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.545322 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.545322 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.545652 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.545824 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.545996 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.546177 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.546687 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.546866 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.547040 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.547221 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.547401 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.547585 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.547770 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.547942 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.548274 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.548474 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.548648 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.548830 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.549018 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.549201 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.549381 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.549562 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.549743 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.550162 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.550350 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.550523 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.550682 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.550841 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.550982 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.551129 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.551276 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.551423 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.551562 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.551709 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.551855 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.551994 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.552140 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.552292 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.552438 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.552591 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.552738 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.552877 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.552877 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.553146 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.553294 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.553442 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.553588 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.553727 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.553873 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.554027 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.554181 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.554339 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.554339 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.554664 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.554814 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.554953 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.554953 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.555230 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.555230 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.555499 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.555499 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.555775 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.555931 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.556070 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.556215 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.556354 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.556661 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.556877 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.557029 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.557183 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.557329 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.557470 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.557624 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.557779 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.557925 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.558079 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.558240 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.558609 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.558777 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.558933 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.559080 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.559225 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.559371 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.559525 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.559671 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.559829 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.559983 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.560317 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.560482 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.560630 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.560885 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.561045 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.561193 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.561339 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.561491 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.561637 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.561871 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.562019 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.562165 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.562317 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.562480 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.562713 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.562877 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.563025 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.563177 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.563332 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.563479 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.563623 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.563778 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.563932 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.564090 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.564239 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.564385 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.564549 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.564703 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.564857 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.565011 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.565158 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.565309 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.565309 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.565595 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.565746 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.565892 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.566239 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.566402 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.566589 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.566989 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.567142 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.567289 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.567441 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.567587 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.567741 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.567888 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.568034 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.568179 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.568323 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.568637 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.568801 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.568955 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.569120 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.569267 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.569412 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.569571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.569718 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.569870 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.570016 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.570163 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.570576 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.570576 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.570885 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.571032 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.571178 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.571334 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.571486 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.571645 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.571798 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.571944 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.572088 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.572234 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.572392 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.572553 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.572698 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.572850 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.573002 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.573158 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.573318 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.573463 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.573607 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.573759 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.573911 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.574060 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.574214 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.574368 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.577128 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.577315 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.577473 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.577624 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.577802 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.577961 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.578109 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.578263 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.578424 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.578785 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.578951 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.579101 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.579245 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.579398 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.579552 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.579712 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.579712 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.580016 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.580164 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.580309 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.580470 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.580826 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.580977 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.581123 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.581268 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.581414 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.581559 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.581721 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.581876 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.582023 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.582179 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.582332 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.582491 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.582663 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.582821 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.582968 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.583130 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.583277 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.583432 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.583578 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.583729 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.583885 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.584046 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.584192 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.584351 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.584504 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.584657 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.584811 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.584957 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.584957 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.585248 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.585395 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.585547 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.585700 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.585854 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.586019 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.586173 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.586318 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.586462 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.586681 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.586917 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.587286 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.587456 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.587603 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.587749 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.587908 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.588063 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.588211 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.588366 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.588511 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.588656 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.588966 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.589120 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.589266 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.589410 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.589555 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.589709 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.589862 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.590009 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.590009 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.590293 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.590458 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.590708 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.590708 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.591198 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.591351 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.591504 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.591650 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.591817 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.592029 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.592279 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.592472 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.592652 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.592854 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.593033 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.593214 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.593392 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.593392 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.593749 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.594011 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.594202 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.594382 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.594563 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.594739 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.594898 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.595055 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.595217 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.595371 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.595524 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.595678 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.595831 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.595986 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.596133 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.596278 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.596430 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.596584 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.596740 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.596886 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.597030 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.597416 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.597577 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.597724 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.597882 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.598029 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.598174 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.598318 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.598472 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.598730 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.599053 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.599217 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.599372 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.599520 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.599675 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.599892 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.600055 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.600203 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.600356 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.600503 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.600648 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.600802 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.600966 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.601226 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.601468 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.601629 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.601793 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.601948 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.602100 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.602247 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.602399 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.602562 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.602562 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.602872 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.603025 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.603171 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.603324 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.603471 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.603625 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.603805 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.603961 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.604115 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.604274 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.604420 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.604579 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.604733 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.604888 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.605040 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.605252 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.605399 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.605552 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.605699 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.605856 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.606009 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.606155 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.606299 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.606454 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.606625 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.606784 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.606938 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.607084 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.607229 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.607620 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.607814 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.607964 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.608121 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.608266 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.608425 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.608578 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.608732 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.608878 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.609041 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.609326 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.609485 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.609630 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.609788 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.609943 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.610109 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.610255 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.610408 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.610600 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.610822 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.610979 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.611126 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.611387 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.611645 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.611798 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.611944 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.612395 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.612548 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.612714 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.612860 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.613004 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.613157 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.613301 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.613453 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.613607 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.613770 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.613925 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.614072 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.614218 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.614369 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.614546 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.614709 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.614865 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.615012 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.615158 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.615301 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.615454 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.615608 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.615755 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.615900 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.616044 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.616191 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.616402 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.616549 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.616715 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.616869 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.617021 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.617176 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.617323 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.617486 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.617834 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.617982 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.618127 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.618282 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.618428 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.618595 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.618758 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.618903 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.619049 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.619349 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.619503 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.619641 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.619779 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.619923 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.620063 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.620210 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.620347 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.620485 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.620608 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.620704 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.620786 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.620858 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.620935 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.621005 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.621082 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.621220 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.621302 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.621392 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.621474 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.621546 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.621804 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.621890 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.621972 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.622052 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.622125 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.622202 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.622282 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.622366 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.622366 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.622502 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.622595 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.622665 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.622665 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.622806 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.622876 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.622953 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.623023 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.623092 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.623196 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.623342 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.623342 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.623493 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.623571 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.623651 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.623729 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.623807 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.623876 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.623944 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.624087 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.624175 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.624247 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.624315 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.624397 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.624469 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.624545 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.625075 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.625167 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.625246 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.625325 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.625396 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.625466 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.625556 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.625748 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.625880 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.626013 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.626156 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.626307 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.626459 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.626610 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.626757 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.626757 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.627019 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.627171 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.627314 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.627447 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.627590 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.627959 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.628095 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.628239 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.628373 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.628504 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.628645 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.628779 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.628911 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.629014 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.629088 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.629158 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.629227 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.629446 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.629541 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.629624 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.629702 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.629702 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.629828 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.629906 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.629990 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.629990 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.630134 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.630134 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.630134 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.630134 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.630134 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.630431 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.630501 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.630895 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.631030 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.631178 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.631313 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.631458 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.631598 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.631782 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.632079 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.632223 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.632377 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.632512 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.632644 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.632778 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.632922 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.633078 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.633211 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.633355 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.633502 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.633645 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.633790 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.633932 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.634080 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.634227 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.634359 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.634492 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.634660 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.634794 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.634927 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.634927 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.635191 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.635326 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.635480 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.635480 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.635731 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.635731 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.635981 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.636133 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.636279 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.636413 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.636558 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.636558 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.636807 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.636959 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.637102 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.637243 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.637375 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.637522 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.637654 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.637998 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.638145 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.638280 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.638425 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.638617 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.638764 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.638939 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.639079 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.639223 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.639223 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.639742 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.639893 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.639893 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.640156 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.640298 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.640298 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.640575 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.640763 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.640898 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.641031 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.641170 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.641508 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.641508 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.641788 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.641922 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.641922 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.642363 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.642525 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.642525 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.642797 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.642933 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.642933 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.643185 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.643318 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.643470 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.643604 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.643604 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.643604 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.644010 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.644144 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.644144 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.644426 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.644658 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.644658 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.644963 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.645121 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.645301 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.645470 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.645470 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.645779 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.645939 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.646097 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.646274 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.646274 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.646616 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.646786 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.646786 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.647099 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.647266 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.647434 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.647546 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.647546 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.647717 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.648140 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.648260 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.648354 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.648354 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.648517 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.648608 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.648608 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.648780 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.648865 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.649038 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.649159 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.649159 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.649333 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.649419 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.649419 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.649569 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.649833 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.649987 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.650083 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.650083 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.650245 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.650338 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.650423 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.650582 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.650582 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.650769 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.650863 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.650957 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.651042 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.651042 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.651213 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.651298 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.651298 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.651457 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.651549 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.651634 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.651724 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.651724 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.651724 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.651724 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.652022 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.652115 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.652411 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.652515 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.652515 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.652515 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.652515 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.652845 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.652930 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.652930 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.652930 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.652930 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.653236 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.653321 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.653321 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.653321 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.653563 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.653664 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.653750 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.654102 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.654216 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.654646 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.654767 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.654935 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.655250 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.655344 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.655648 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.655809 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.655973 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.656296 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.656389 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.656716 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.656868 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.656969 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.657267 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.657424 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.657591 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.657913 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.658026 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.658327 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.658467 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.659038 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.659038 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.659218 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.659332 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.659549 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.659668 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.659772 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.660073 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.660167 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.660403 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.660644 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.660746 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.661064 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.661197 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.661394 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.661704 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.661809 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.662022 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.662310 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.662620 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.662848 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.662941 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.663208 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.663548 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.663740 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.663880 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.664216 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.664399 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.664544 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.664868 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.664959 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.665201 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.665460 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.665562 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.665811 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.666052 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.666153 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.666442 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.666625 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.666785 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.667105 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.667196 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.667422 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.667665 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.667757 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.668049 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.668384 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.668488 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.668713 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.668899 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.669206 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.669314 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.669569 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.669785 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.669895 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.670336 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.670497 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.670776 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.671027 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.671126 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.671414 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.671589 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.671731 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.672053 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.672143 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.672376 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.672727 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.672843 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.672995 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.673202 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.673304 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.673611 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.673765 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.673930 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.674313 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.674423 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.675099 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.675212 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.675307 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.675307 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.675460 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.675553 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.675808 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.676016 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.676122 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.676622 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.676736 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.676834 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.677036 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.677135 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.677350 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.677611 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.677711 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.677968 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.678175 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.678266 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.678609 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.678766 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.678907 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.679227 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.679319 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.679539 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.679850 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.679954 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.680216 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.680430 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.680523 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.680781 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.681001 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.681101 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.681403 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.681710 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.681810 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.682041 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.682292 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.682395 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.682762 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.682877 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.683055 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.683375 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.683467 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.683870 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.683972 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.684322 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.684424 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.684656 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.684945 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.685058 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.685346 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.685542 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.685706 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.686065 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.686164 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.686401 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.686688 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.686781 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.687086 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.687281 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.687406 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.687727 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.688132 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.688241 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.688337 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.688422 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.688754 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.688931 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.689024 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.689279 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.689411 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.689599 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.689854 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.689968 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.690257 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.690359 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.690613 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.690845 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.690972 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.691251 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.691351 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.691577 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.691827 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.691932 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.692198 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.692324 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.692521 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.692777 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.692874 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.693147 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.693262 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.693489 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.693715 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.693819 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.694112 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.694218 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.694572 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.694670 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.694896 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.695114 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.695208 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.695535 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.695637 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.695854 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.696051 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.696182 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.696509 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.696602 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.696827 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.697011 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.697154 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.697456 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.697560 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.697795 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.697950 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.698141 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.698399 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.698491 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.698832 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.698943 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.699145 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.699343 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.699457 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.699769 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.699870 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.700090 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.700299 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.700428 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.700731 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.700891 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.701075 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.701244 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.701619 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.701715 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.701999 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.702175 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.702334 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.702647 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.702745 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.703004 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.703148 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.703333 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.703610 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.703704 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.703962 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.704109 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.704304 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.704561 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.704654 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.704928 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.705052 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.705247 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.705495 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.705602 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.705869 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.705992 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.706186 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.706449 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.706570 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.706874 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.706966 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.707188 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.707418 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.707521 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.707829 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.707930 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.708155 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.708370 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.708473 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.708781 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.708893 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.709121 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.709329 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.709421 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.709766 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.709874 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.710064 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.710309 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.710403 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.710719 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.710832 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.711045 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.711197 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.711380 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.711514 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.711715 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.711824 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 23 11:57:54.712048 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.712381 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.712738 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.713694 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.713694 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.713694 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.714711 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.715214 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.715563 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:57:54.715829 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 23 11:57:54.735386 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_db.sqlalchemy.engines [None req-59894a27-e567-412a-8fde-c090041ea3be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:57:54.739432 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_db.sqlalchemy.engines [None req-ea9dd8c3-f2a6-4e3f-a22b-501ca0d90af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:57:54.804192 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.context [None req-59894a27-e567-412a-8fde-c090041ea3be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f84be753-2dc6-40a4-9555-fbe0caef5ac0(cell1) {{(pid=116355) load_cells /opt/stack/nova/nova/context.py:464}} Dec 23 11:57:54.804406 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.context [None req-ea9dd8c3-f2a6-4e3f-a22b-501ca0d90af5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f84be753-2dc6-40a4-9555-fbe0caef5ac0(cell1) {{(pid=116354) load_cells /opt/stack/nova/nova/context.py:464}} Dec 23 11:57:54.808367 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-59894a27-e567-412a-8fde-c090041ea3be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:57:54.808547 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ea9dd8c3-f2a6-4e3f-a22b-501ca0d90af5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:57:54.809984 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ea9dd8c3-f2a6-4e3f-a22b-501ca0d90af5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:57:54.810122 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-59894a27-e567-412a-8fde-c090041ea3be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:57:54.810851 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ea9dd8c3-f2a6-4e3f-a22b-501ca0d90af5 None None] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:57:54.811011 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-59894a27-e567-412a-8fde-c090041ea3be None None] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:57:54.812819 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ea9dd8c3-f2a6-4e3f-a22b-501ca0d90af5 None None] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:57:54.812974 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-59894a27-e567-412a-8fde-c090041ea3be None None] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:57:54.826101 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_db.sqlalchemy.engines [None req-ea9dd8c3-f2a6-4e3f-a22b-501ca0d90af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:57:54.827821 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_db.sqlalchemy.engines [None req-59894a27-e567-412a-8fde-c090041ea3be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:57:54.828247 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_db.sqlalchemy.engines [None req-ea9dd8c3-f2a6-4e3f-a22b-501ca0d90af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:57:54.829455 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_db.sqlalchemy.engines [None req-59894a27-e567-412a-8fde-c090041ea3be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:57:54.988379 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_db.sqlalchemy.engines [None req-59894a27-e567-412a-8fde-c090041ea3be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:57:54.994890 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_db.sqlalchemy.engines [None req-ea9dd8c3-f2a6-4e3f-a22b-501ca0d90af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:57:55.313841 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: WARNING keystonemiddleware.auth_token [None req-59894a27-e567-412a-8fde-c090041ea3be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 23 11:57:55.316826 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: WARNING keystonemiddleware.auth_token [None req-ea9dd8c3-f2a6-4e3f-a22b-501ca0d90af5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 23 11:57:55.320781 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: WARNING keystonemiddleware.auth_token [None req-59894a27-e567-412a-8fde-c090041ea3be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 23 11:57:55.323455 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: WARNING keystonemiddleware.auth_token [None req-ea9dd8c3-f2a6-4e3f-a22b-501ca0d90af5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 23 11:57:55.668151 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: WARNING keystonemiddleware.auth_token [None req-59894a27-e567-412a-8fde-c090041ea3be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 23 11:57:55.673610 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: WARNING keystonemiddleware.auth_token [None req-59894a27-e567-412a-8fde-c090041ea3be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 23 11:57:55.679077 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55caed87c9c0 pid: 116355 (default app) Dec 23 11:57:55.681190 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: WARNING keystonemiddleware.auth_token [None req-ea9dd8c3-f2a6-4e3f-a22b-501ca0d90af5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 23 11:57:55.686434 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: WARNING keystonemiddleware.auth_token [None req-ea9dd8c3-f2a6-4e3f-a22b-501ca0d90af5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 23 11:57:55.691812 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55caed87c9c0 pid: 116354 (default app) Dec 23 11:58:28.918355 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a4859c4c-ef0b-4f2d-b309-b64bfe7ae051 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Action: 'create', calling method: .version_select at 0x7fcf2a525e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-172554686"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:58:30.091914 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a859b804-d046-445b-9a56-e9c78fe489da tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] Action: 'create', calling method: .version_select at 0x7fcf2a517ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1809863046", "metadata": {"Type": "work"}}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:58:30.094740 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a859b804-d046-445b-9a56-e9c78fe489da tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:58:30.095994 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a859b804-d046-445b-9a56-e9c78fe489da tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.117711 Dec 23 11:58:30.102167 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 1/1] 10.222.0.65 () {60 vars in 1155 bytes} [Thu Dec 23 11:58:28 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 23 11:58:30.582455 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-93c6b2bb-40fc-4d68-9d3c-28738092abed tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-892418945", "imageRef": "938a78c0-341e-4043-927a-9bfe8cf52508", "flavorRef": "452", "networks": [{"uuid": "ac51d859-bbbe-4f9f-9707-22f475d5dcb6"}]}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:58:31.007644 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a4859c4c-ef0b-4f2d-b309-b64bfe7ae051 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.249556 Dec 23 11:58:31.008558 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 1/2] 10.222.0.65 () {60 vars in 1154 bytes} [Thu Dec 23 11:58:27 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3252 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 23 11:58:31.014115 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3a5718c8-cecf-4466-9d3d-df3a046926fe tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] Action: 'create', calling method: .version_select at 0x7fcf2a4509d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1386118902", "metadata": {"Type": "work"}}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:58:31.022894 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3a5718c8-cecf-4466-9d3d-df3a046926fe tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:58:31.023755 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3a5718c8-cecf-4466-9d3d-df3a046926fe tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014118 Dec 23 11:58:31.024373 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 2/3] 10.222.0.65 () {60 vars in 1155 bytes} [Thu Dec 23 11:58:31 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 23 11:58:31.054895 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a4e2b5ab-b670-412d-a124-e8937b078ec1 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf2ad75670>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:31.130306 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a4e2b5ab-b670-412d-a124-e8937b078ec1 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/e2df4085-d48d-4a68-b806-cfc21f56f4b9" status: 200 len: 344 microversion: 2.1 time: 0.093694 Dec 23 11:58:31.131730 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 3/4] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Dec 23 11:58:31 2021] GET /compute/v2.1/os-volumes/e2df4085-d48d-4a68-b806-cfc21f56f4b9 => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:58:31.136439 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-27ecd5c4-81a0-498c-bb9c-acdd497ad77c tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] Action: 'create', calling method: .version_select at 0x7fcf2a40d280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-619934562", "metadata": {"Type": "work"}}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:58:31.137900 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-27ecd5c4-81a0-498c-bb9c-acdd497ad77c tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:58:31.139387 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-27ecd5c4-81a0-498c-bb9c-acdd497ad77c tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006217 Dec 23 11:58:31.142815 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 4/5] 10.222.0.65 () {60 vars in 1155 bytes} [Thu Dec 23 11:58:31 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 23 11:58:31.154910 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-893ddd24-23fa-4f82-a57c-0d4763186872 tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] Calling method '.version_select at 0x7fcf2a40ddc0>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:31.226736 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-893ddd24-23fa-4f82-a57c-0d4763186872 tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] HTTP exception thrown: Volume tempest-invalid-499344387 could not be found. Dec 23 11:58:31.227764 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-893ddd24-23fa-4f82-a57c-0d4763186872 tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] Returning 404 to user: Volume tempest-invalid-499344387 could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:58:31.228669 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-893ddd24-23fa-4f82-a57c-0d4763186872 tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-499344387" status: 404 len: 98 microversion: 2.1 time: 0.079770 Dec 23 11:58:31.233890 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 5/6] 10.222.0.65 () {58 vars in 1214 bytes} [Thu Dec 23 11:58:31 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-499344387 => generated 98 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 23 11:58:31.240082 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-eaec1b0a-ce47-4e1b-8eaf-924fc65d766e tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004322 Dec 23 11:58:31.253577 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 6/7] 10.222.0.65 () {58 vars in 1139 bytes} [Thu Dec 23 11:58:31 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 23 11:58:31.261065 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2028f793-98a0-4946-88dd-9e9c2b40e532 tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006243 Dec 23 11:58:31.272944 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.network.neutron [None req-93c6b2bb-40fc-4d68-9d3c-28738092abed tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] validate_networks() for [('ac51d859-bbbe-4f9f-9707-22f475d5dcb6', None, None, None, None, None)] {{(pid=116354) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 11:58:31.281299 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 7/8] 10.222.0.65 () {58 vars in 1136 bytes} [Thu Dec 23 11:58:31 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 23 11:58:31.295407 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-07777188-43ad-4e6e-81b5-3815cec36604 tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] Calling method '.version_select at 0x7fcf2a40d820>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:31.323271 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-07777188-43ad-4e6e-81b5-3815cec36604 tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] HTTP exception thrown: Volume 938263d1-9d9e-4fa5-9542-cab4705e4364 could not be found. Dec 23 11:58:31.323871 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-07777188-43ad-4e6e-81b5-3815cec36604 tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] Returning 404 to user: Volume 938263d1-9d9e-4fa5-9542-cab4705e4364 could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:58:31.324830 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-07777188-43ad-4e6e-81b5-3815cec36604 tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/938263d1-9d9e-4fa5-9542-cab4705e4364" status: 404 len: 109 microversion: 2.1 time: 0.041292 Dec 23 11:58:31.325399 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 8/9] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Dec 23 11:58:31 2021] DELETE /compute/v2.1/os-volumes/938263d1-9d9e-4fa5-9542-cab4705e4364 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 11:58:31.337346 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-7f29365c-747d-43d4-b75f-51c47d1a72d1 tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] Calling method '.version_select at 0x7fcf2a40d0d0>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:31.401905 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-7f29365c-747d-43d4-b75f-51c47d1a72d1 tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] HTTP exception thrown: Volume eb1462c9-6f21-4239-8173-e35799862e8f could not be found. Dec 23 11:58:31.402898 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-7f29365c-747d-43d4-b75f-51c47d1a72d1 tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] Returning 404 to user: Volume eb1462c9-6f21-4239-8173-e35799862e8f could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:58:31.404499 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-7f29365c-747d-43d4-b75f-51c47d1a72d1 tempest-VolumesNegativeTest-1201237768 tempest-VolumesNegativeTest-1201237768-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/eb1462c9-6f21-4239-8173-e35799862e8f" status: 404 len: 109 microversion: 2.1 time: 0.072737 Dec 23 11:58:31.413549 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 9/10] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Dec 23 11:58:31 2021] GET /compute/v2.1/os-volumes/eb1462c9-6f21-4239-8173-e35799862e8f => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 23 11:58:32.052678 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0ff540ec-5fa1-4191-98ce-8ff2b586bb80 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] Calling method '.version_select at 0x7fcf2a3f9f70>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:32.140197 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0ff540ec-5fa1-4191-98ce-8ff2b586bb80 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/77a93649-bc40-4e94-a5ff-be0d7cb55eb3" status: 200 len: 351 microversion: 2.1 time: 0.091374 Dec 23 11:58:32.141607 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 10/11] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Dec 23 11:58:32 2021] GET /compute/v2.1/os-volumes/77a93649-bc40-4e94-a5ff-be0d7cb55eb3 => generated 351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 11:58:32.161371 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-be6ecde6-c84e-42a6-88e3-360f7c79a6f0 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf2a3f9b80>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:32.264403 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-be6ecde6-c84e-42a6-88e3-360f7c79a6f0 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/e2df4085-d48d-4a68-b806-cfc21f56f4b9" status: 200 len: 345 microversion: 2.1 time: 0.115742 Dec 23 11:58:32.265238 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 11/12] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Dec 23 11:58:32 2021] GET /compute/v2.1/os-volumes/e2df4085-d48d-4a68-b806-cfc21f56f4b9 => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:58:32.278814 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8c1cc715-7958-4297-8dee-40e4b2c5c9d9 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Action: 'create', calling method: .version_select at 0x7fcf2a40d280>, body: {"snapshot": {"volume_id": "e2df4085-d48d-4a68-b806-cfc21f56f4b9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-155612248"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:58:32.836562 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-8c1cc715-7958-4297-8dee-40e4b2c5c9d9 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.564029 Dec 23 11:58:32.837145 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 12/13] 10.222.0.65 () {60 vars in 1161 bytes} [Thu Dec 23 11:58:32 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 11:58:32.849951 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f274421b-830d-4acc-a7f3-e707ee11dcd0 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf2a4509d0>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:32.898207 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f274421b-830d-4acc-a7f3-e707ee11dcd0 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df" status: 200 len: 286 microversion: 2.1 time: 0.054302 Dec 23 11:58:32.898822 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 13/14] 10.222.0.65 () {58 vars in 1250 bytes} [Thu Dec 23 11:58:32 2021] GET /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 11:58:32.909666 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-abba3bec-f698-4381-98b0-07b5d777bc77 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf2a40da60>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:32.927031 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-93c6b2bb-40fc-4d68-9d3c-28738092abed tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Flavor limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 11:58:32.927617 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-93c6b2bb-40fc-4d68-9d3c-28738092abed tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Image limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 11:58:32.928127 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-93c6b2bb-40fc-4d68-9d3c-28738092abed tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Flavor pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 11:58:32.928603 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-93c6b2bb-40fc-4d68-9d3c-28738092abed tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Image pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 11:58:32.929088 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-93c6b2bb-40fc-4d68-9d3c-28738092abed tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 11:58:32.961868 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-93c6b2bb-40fc-4d68-9d3c-28738092abed tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:32.962444 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-93c6b2bb-40fc-4d68-9d3c-28738092abed tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:32.979420 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-93c6b2bb-40fc-4d68-9d3c-28738092abed tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:32.980248 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-93c6b2bb-40fc-4d68-9d3c-28738092abed tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:33.021463 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-abba3bec-f698-4381-98b0-07b5d777bc77 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.115705 Dec 23 11:58:33.023747 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 14/15] 10.222.0.65 () {58 vars in 1139 bytes} [Thu Dec 23 11:58:32 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:58:33.033714 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f09eb0f5-cd7d-4fdb-9831-f1aee798a318 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf2a3f9ca0>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:33.067624 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-93c6b2bb-40fc-4d68-9d3c-28738092abed tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Getting quotas for project cf852b4ffd784cc6a4c15059be11f5c8. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 11:58:33.091673 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-93c6b2bb-40fc-4d68-9d3c-28738092abed tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Getting quotas for user 9b39dd77d85e4eb1bc76c00e071e97c6 and project cf852b4ffd784cc6a4c15059be11f5c8. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 11:58:33.140491 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-93c6b2bb-40fc-4d68-9d3c-28738092abed tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Going to run 1 instances... {{(pid=116354) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 11:58:33.148773 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-93c6b2bb-40fc-4d68-9d3c-28738092abed tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='938a78c0-341e-4043-927a-9bfe8cf52508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 11:58:33.161291 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f09eb0f5-cd7d-4fdb-9831-f1aee798a318 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df" status: 200 len: 286 microversion: 2.1 time: 0.130412 Dec 23 11:58:33.161884 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 15/16] 10.222.0.65 () {58 vars in 1250 bytes} [Thu Dec 23 11:58:33 2021] GET /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df => generated 286 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 11:58:33.345465 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-93c6b2bb-40fc-4d68-9d3c-28738092abed tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.241288 Dec 23 11:58:33.346384 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 2/17] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 11:58:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 3243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 11:58:33.356427 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-7c4af567-36c2-419a-b4f9-28fba72409bd tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:33.357618 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-7c4af567-36c2-419a-b4f9-28fba72409bd tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:33.670485 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-7c4af567-36c2-419a-b4f9-28fba72409bd tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:33.692342 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-7c4af567-36c2-419a-b4f9-28fba72409bd tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1214 microversion: 2.1 time: 0.339181 Dec 23 11:58:33.693598 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 16/18] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:33 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1214 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:33.812418 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-83a72a28-7f37-4546-946f-66a7384d0045 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] Calling method '.version_select at 0x7fcf29b2e820>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:33.949648 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-83a72a28-7f37-4546-946f-66a7384d0045 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/bc198246-ca01-4c67-8dcf-63478413c422" status: 200 len: 350 microversion: 2.1 time: 0.141558 Dec 23 11:58:33.952036 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 3/19] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Dec 23 11:58:33 2021] GET /compute/v2.1/os-volumes/bc198246-ca01-4c67-8dcf-63478413c422 => generated 350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:58:34.173085 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f62172c2-1943-4bc9-9c3d-011c86699d0f tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf2a3a1670>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:34.228477 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f62172c2-1943-4bc9-9c3d-011c86699d0f tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df" status: 200 len: 286 microversion: 2.1 time: 0.059127 Dec 23 11:58:34.233201 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 17/20] 10.222.0.65 () {58 vars in 1250 bytes} [Thu Dec 23 11:58:34 2021] GET /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:58:34.711785 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-64f18782-3eba-44ce-91d8-55274dcdcb80 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:34.712536 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-64f18782-3eba-44ce-91d8-55274dcdcb80 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:34.893928 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-64f18782-3eba-44ce-91d8-55274dcdcb80 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:34.920532 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-64f18782-3eba-44ce-91d8-55274dcdcb80 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1214 microversion: 2.1 time: 0.212831 Dec 23 11:58:34.921584 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 4/21] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:34 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:35.243504 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a85e264a-0171-4dcf-99f2-efd9329870c9 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf2a3589d0>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:35.320901 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a85e264a-0171-4dcf-99f2-efd9329870c9 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df" status: 200 len: 286 microversion: 2.1 time: 0.081985 Dec 23 11:58:35.321862 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 18/22] 10.222.0.65 () {58 vars in 1250 bytes} [Thu Dec 23 11:58:35 2021] GET /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:58:35.937293 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e4a3f06e-da95-4863-b43d-827c118a0086 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:35.937904 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e4a3f06e-da95-4863-b43d-827c118a0086 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:35.952454 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e4a3f06e-da95-4863-b43d-827c118a0086 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:35.953421 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e4a3f06e-da95-4863-b43d-827c118a0086 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:35.954741 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e4a3f06e-da95-4863-b43d-827c118a0086 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:35.957409 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e4a3f06e-da95-4863-b43d-827c118a0086 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:36.324982 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e4a3f06e-da95-4863-b43d-827c118a0086 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:36.332690 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-08718424-318d-4112-b8c7-54281121011e tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf2a358e50>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:36.342371 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e4a3f06e-da95-4863-b43d-827c118a0086 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1218 microversion: 2.1 time: 0.409012 Dec 23 11:58:36.366241 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 5/23] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:35 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1218 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:36.407754 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-08718424-318d-4112-b8c7-54281121011e tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df" status: 200 len: 286 microversion: 2.1 time: 0.078405 Dec 23 11:58:36.408545 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 19/24] 10.222.0.65 () {58 vars in 1250 bytes} [Thu Dec 23 11:58:36 2021] GET /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 11:58:37.367009 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9718ebfd-197d-40c0-ba70-6bb905a1ba94 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:37.367838 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9718ebfd-197d-40c0-ba70-6bb905a1ba94 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:37.381162 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9718ebfd-197d-40c0-ba70-6bb905a1ba94 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:37.382807 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9718ebfd-197d-40c0-ba70-6bb905a1ba94 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:37.406069 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9718ebfd-197d-40c0-ba70-6bb905a1ba94 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:37.407470 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9718ebfd-197d-40c0-ba70-6bb905a1ba94 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:37.426589 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-9bfcf9d8-1b92-4c5c-9045-810f002e9840 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf2a3584c0>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:37.492314 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-9bfcf9d8-1b92-4c5c-9045-810f002e9840 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df" status: 200 len: 287 microversion: 2.1 time: 0.076410 Dec 23 11:58:37.492869 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 20/25] 10.222.0.65 () {58 vars in 1250 bytes} [Thu Dec 23 11:58:37 2021] GET /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 11:58:37.502984 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-64742e65-22ce-4596-a67e-b70dea9f6d58 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf2a369310>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:37.625981 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-64742e65-22ce-4596-a67e-b70dea9f6d58 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df" status: 202 len: 0 microversion: 2.1 time: 0.126770 Dec 23 11:58:37.626566 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 21/26] 10.222.0.65 () {58 vars in 1253 bytes} [Thu Dec 23 11:58:37 2021] DELETE /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 23 11:58:37.638292 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f5b6ab35-39b9-4479-891d-43c1a2d001cc tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf2a3a1670>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:37.651249 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9718ebfd-197d-40c0-ba70-6bb905a1ba94 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:37.660701 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9718ebfd-197d-40c0-ba70-6bb905a1ba94 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1210 microversion: 2.1 time: 0.300316 Dec 23 11:58:37.674486 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 6/27] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:37 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1210 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:37.712445 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f5b6ab35-39b9-4479-891d-43c1a2d001cc tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df" status: 200 len: 286 microversion: 2.1 time: 0.081004 Dec 23 11:58:37.713219 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 22/28] 10.222.0.65 () {58 vars in 1250 bytes} [Thu Dec 23 11:58:37 2021] GET /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 11:58:38.061047 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2613ed37-f18e-483f-8c57-9aaddc093571 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] Calling method '.version_select at 0x7fcf29234e50>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:38.183571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2613ed37-f18e-483f-8c57-9aaddc093571 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/1f5ee3a8-8508-4080-b1ab-1d3eaf147277" status: 200 len: 351 microversion: 2.1 time: 0.126438 Dec 23 11:58:38.184235 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 7/29] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Dec 23 11:58:38 2021] GET /compute/v2.1/os-volumes/1f5ee3a8-8508-4080-b1ab-1d3eaf147277 => generated 351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:58:38.196830 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d2b6165b-4c23-42a5-a8e3-7afe2dbca8a2 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] Calling method '.version_select at 0x7fcf2a358af0>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:38.453783 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d2b6165b-4c23-42a5-a8e3-7afe2dbca8a2 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.260829 Dec 23 11:58:38.454682 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 23/30] 10.222.0.65 () {58 vars in 1133 bytes} [Thu Dec 23 11:58:38 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:38.475193 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-435f1ea6-81d4-441c-8ac8-4ae49fbce763 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] Calling method '.version_select at 0x7fcf291f2550>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:38.691421 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f981c45b-12cc-419f-806d-29ac67db92ee tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:38.692276 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f981c45b-12cc-419f-806d-29ac67db92ee tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:38.721421 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-435f1ea6-81d4-441c-8ac8-4ae49fbce763 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.256038 Dec 23 11:58:38.722002 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 8/31] 10.222.0.65 () {58 vars in 1148 bytes} [Thu Dec 23 11:58:38 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:58:38.748632 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ca7aab57-662a-47f9-a137-836e2bfd812c tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf29200e50>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:38.756471 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f981c45b-12cc-419f-806d-29ac67db92ee tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:38.756636 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f981c45b-12cc-419f-806d-29ac67db92ee tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:38.757520 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f981c45b-12cc-419f-806d-29ac67db92ee tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:38.757912 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f981c45b-12cc-419f-806d-29ac67db92ee tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:38.820502 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-ca7aab57-662a-47f9-a137-836e2bfd812c tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] HTTP exception thrown: Snapshot c7208caa-4410-4f7f-8a8a-4543ce1606df could not be found. Dec 23 11:58:38.821101 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ca7aab57-662a-47f9-a137-836e2bfd812c tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Returning 404 to user: Snapshot c7208caa-4410-4f7f-8a8a-4543ce1606df could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:58:38.821967 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ca7aab57-662a-47f9-a137-836e2bfd812c tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df" status: 404 len: 111 microversion: 2.1 time: 0.090622 Dec 23 11:58:38.826336 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 9/32] 10.222.0.65 () {58 vars in 1250 bytes} [Thu Dec 23 11:58:38 2021] GET /compute/v2.1/os-snapshots/c7208caa-4410-4f7f-8a8a-4543ce1606df => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 11:58:38.839734 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-624b9207-c3e0-420f-a1dd-c2992e2b1325 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] Calling method '.version_select at 0x7fcf29200820>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:39.048419 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-624b9207-c3e0-420f-a1dd-c2992e2b1325 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.223628 Dec 23 11:58:39.049086 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 10/33] 10.222.0.65 () {58 vars in 1133 bytes} [Thu Dec 23 11:58:38 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:39.074475 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2b4cc066-a0e2-4b42-917e-b87dd85437d0 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf29b2ea60>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:39.193498 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-f981c45b-12cc-419f-806d-29ac67db92ee tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:39.219854 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f981c45b-12cc-419f-806d-29ac67db92ee tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1272 microversion: 2.1 time: 0.532392 Dec 23 11:58:39.249771 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 24/34] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:38 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1272 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:39.257509 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2d6f8e28-86ce-4c84-b61c-ddaa404d8f19 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] Calling method '.version_select at 0x7fcf2f659550>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:39.269849 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2b4cc066-a0e2-4b42-917e-b87dd85437d0 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/e2df4085-d48d-4a68-b806-cfc21f56f4b9" status: 202 len: 0 microversion: 2.1 time: 0.217912 Dec 23 11:58:39.270440 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 11/35] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Dec 23 11:58:39 2021] DELETE /compute/v2.1/os-volumes/e2df4085-d48d-4a68-b806-cfc21f56f4b9 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 11:58:39.279140 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0c8fa647-aec4-4ab9-9568-c196caf4f425 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf29200700>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:39.451994 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0c8fa647-aec4-4ab9-9568-c196caf4f425 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/e2df4085-d48d-4a68-b806-cfc21f56f4b9" status: 200 len: 344 microversion: 2.1 time: 0.177176 Dec 23 11:58:39.452682 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 12/36] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Dec 23 11:58:39 2021] GET /compute/v2.1/os-volumes/e2df4085-d48d-4a68-b806-cfc21f56f4b9 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 11:58:39.453813 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2d6f8e28-86ce-4c84-b61c-ddaa404d8f19 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.194387 Dec 23 11:58:39.454709 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 25/37] 10.222.0.65 () {58 vars in 1166 bytes} [Thu Dec 23 11:58:39 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:58:39.468612 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-6d678f5e-ff2a-427e-a9c9-96d6c626ec21 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] Calling method '.version_select at 0x7fcf2a2e2ca0>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:39.704145 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-6d678f5e-ff2a-427e-a9c9-96d6c626ec21 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.239151 Dec 23 11:58:39.704940 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 26/38] 10.222.0.65 () {58 vars in 1169 bytes} [Thu Dec 23 11:58:39 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:58:39.718894 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0b833823-56d2-46e0-b43e-73bc2bfe5f1b tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] Calling method '.version_select at 0x7fcf2a2e2dc0>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:39.915790 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5bc60690-dd27-44ab-b761-7d897d0a2ef2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'create', calling method: .version_select at 0x7fcf29b48430>, body: {"keypair": {"name": "tempest-keypair-1574063945"}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:58:39.944603 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0b833823-56d2-46e0-b43e-73bc2bfe5f1b tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.230645 Dec 23 11:58:39.945467 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 27/39] 10.222.0.65 () {58 vars in 1154 bytes} [Thu Dec 23 11:58:39 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:39.956848 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2c9e847a-1095-422c-9624-a2bd0ca1bbb9 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] Calling method '.version_select at 0x7fcf2a309f70>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:39.975124 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-5bc60690-dd27-44ab-b761-7d897d0a2ef2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Getting quotas for project e6c655658b5f4f53b4145ea20afcf1d4. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 11:58:39.988543 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-5bc60690-dd27-44ab-b761-7d897d0a2ef2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Getting quotas for user 804530daa2704fcdb1fef91615b62c99 and project e6c655658b5f4f53b4145ea20afcf1d4. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 11:58:40.179438 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2c9e847a-1095-422c-9624-a2bd0ca1bbb9 tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.226768 Dec 23 11:58:40.181097 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 28/40] 10.222.0.65 () {58 vars in 1187 bytes} [Thu Dec 23 11:58:39 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 11:58:40.191957 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-502e7252-eefd-4210-93ba-c1d2517a8f5b tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] Calling method '.version_select at 0x7fcf2a2a39d0>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:40.314918 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-502e7252-eefd-4210-93ba-c1d2517a8f5b tempest-VolumesTestJSON-1117940912 tempest-VolumesTestJSON-1117940912-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.126631 Dec 23 11:58:40.315798 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 29/41] 10.222.0.65 () {58 vars in 1154 bytes} [Thu Dec 23 11:58:40 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:40.331421 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a3d4b167-34d2-4298-aa37-a842bc146cb1 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:40.332123 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a3d4b167-34d2-4298-aa37-a842bc146cb1 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:40.343456 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a3d4b167-34d2-4298-aa37-a842bc146cb1 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:40.346832 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a3d4b167-34d2-4298-aa37-a842bc146cb1 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:40.347759 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a3d4b167-34d2-4298-aa37-a842bc146cb1 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:40.348668 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a3d4b167-34d2-4298-aa37-a842bc146cb1 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:40.609204 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a3d4b167-34d2-4298-aa37-a842bc146cb1 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:40.621523 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a3d4b167-34d2-4298-aa37-a842bc146cb1 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1272 microversion: 2.1 time: 0.304597 Dec 23 11:58:40.635050 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 30/42] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:40 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1272 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:40.939736 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-5bc60690-dd27-44ab-b761-7d897d0a2ef2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Getting quotas for project e6c655658b5f4f53b4145ea20afcf1d4. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 11:58:40.967921 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-5bc60690-dd27-44ab-b761-7d897d0a2ef2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Getting quotas for user 804530daa2704fcdb1fef91615b62c99 and project e6c655658b5f4f53b4145ea20afcf1d4. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 11:58:41.020032 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5bc60690-dd27-44ab-b761-7d897d0a2ef2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.565656 Dec 23 11:58:41.028556 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 13/43] 10.222.0.65 () {62 vars in 1198 bytes} [Thu Dec 23 11:58:39 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1575 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 23 11:58:41.042868 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c189b433-61a0-4db1-ae85-c91013697b57 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf29200670>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:41.140701 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-c189b433-61a0-4db1-ae85-c91013697b57 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] HTTP exception thrown: Volume e2df4085-d48d-4a68-b806-cfc21f56f4b9 could not be found. Dec 23 11:58:41.141318 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c189b433-61a0-4db1-ae85-c91013697b57 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Returning 404 to user: Volume e2df4085-d48d-4a68-b806-cfc21f56f4b9 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:58:41.142210 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c189b433-61a0-4db1-ae85-c91013697b57 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/e2df4085-d48d-4a68-b806-cfc21f56f4b9" status: 404 len: 109 microversion: 2.1 time: 0.112573 Dec 23 11:58:41.152776 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 14/44] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Dec 23 11:58:41 2021] GET /compute/v2.1/os-volumes/e2df4085-d48d-4a68-b806-cfc21f56f4b9 => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 11:58:41.157877 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d42a0a8f-cdf7-4557-a8e6-683cfd2f7165 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf29190160>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:41.287183 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-d42a0a8f-cdf7-4557-a8e6-683cfd2f7165 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] HTTP exception thrown: Volume e2df4085-d48d-4a68-b806-cfc21f56f4b9 could not be found. Dec 23 11:58:41.287789 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d42a0a8f-cdf7-4557-a8e6-683cfd2f7165 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Returning 404 to user: Volume e2df4085-d48d-4a68-b806-cfc21f56f4b9 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:58:41.288690 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d42a0a8f-cdf7-4557-a8e6-683cfd2f7165 tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/e2df4085-d48d-4a68-b806-cfc21f56f4b9" status: 404 len: 109 microversion: 2.1 time: 0.134624 Dec 23 11:58:41.289334 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 15/45] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Dec 23 11:58:41 2021] DELETE /compute/v2.1/os-volumes/e2df4085-d48d-4a68-b806-cfc21f56f4b9 => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 11:58:41.304048 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-97d10ca4-8af2-4c50-a90e-5e6034a37f0e tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Calling method '.version_select at 0x7fcf291ce280>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:41.311575 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e00eff48-f479-4fc0-bce6-3ff4a50b8f45 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-509143431", "imageRef": "938a78c0-341e-4043-927a-9bfe8cf52508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b549575c-e737-460e-8224-ff10749539d5"}]}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:58:41.423391 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-97d10ca4-8af2-4c50-a90e-5e6034a37f0e tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] HTTP exception thrown: Volume e2df4085-d48d-4a68-b806-cfc21f56f4b9 could not be found. Dec 23 11:58:41.424001 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-97d10ca4-8af2-4c50-a90e-5e6034a37f0e tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] Returning 404 to user: Volume e2df4085-d48d-4a68-b806-cfc21f56f4b9 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:58:41.424829 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-97d10ca4-8af2-4c50-a90e-5e6034a37f0e tempest-VolumesSnapshotsTestJSON-342349398 tempest-VolumesSnapshotsTestJSON-342349398-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/e2df4085-d48d-4a68-b806-cfc21f56f4b9" status: 404 len: 109 microversion: 2.1 time: 0.131341 Dec 23 11:58:41.428450 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 16/46] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Dec 23 11:58:41 2021] GET /compute/v2.1/os-volumes/e2df4085-d48d-4a68-b806-cfc21f56f4b9 => generated 109 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 11:58:41.598277 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.network.neutron [None req-e00eff48-f479-4fc0-bce6-3ff4a50b8f45 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] validate_networks() for [('b549575c-e737-460e-8224-ff10749539d5', None, None, None, None, None)] {{(pid=116355) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 11:58:41.643875 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c32ff4d8-0e3f-4d67-bf71-751e6277561b tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:41.644823 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c32ff4d8-0e3f-4d67-bf71-751e6277561b tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:41.664121 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c32ff4d8-0e3f-4d67-bf71-751e6277561b tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:41.664659 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c32ff4d8-0e3f-4d67-bf71-751e6277561b tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:41.668028 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c32ff4d8-0e3f-4d67-bf71-751e6277561b tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:41.668485 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c32ff4d8-0e3f-4d67-bf71-751e6277561b tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:42.715611 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c32ff4d8-0e3f-4d67-bf71-751e6277561b tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:42.732140 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c32ff4d8-0e3f-4d67-bf71-751e6277561b tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1314 microversion: 2.1 time: 1.093283 Dec 23 11:58:42.734971 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 17/47] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:41 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1314 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:58:43.751758 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3b604518-b78b-49b4-8f3b-c54ea2e05035 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:43.752482 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3b604518-b78b-49b4-8f3b-c54ea2e05035 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:43.764227 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3b604518-b78b-49b4-8f3b-c54ea2e05035 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:43.766957 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3b604518-b78b-49b4-8f3b-c54ea2e05035 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:43.767890 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3b604518-b78b-49b4-8f3b-c54ea2e05035 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:43.771016 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3b604518-b78b-49b4-8f3b-c54ea2e05035 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:44.805606 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-e00eff48-f479-4fc0-bce6-3ff4a50b8f45 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Flavor limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 11:58:44.806157 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-e00eff48-f479-4fc0-bce6-3ff4a50b8f45 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Image limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 11:58:44.806539 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-e00eff48-f479-4fc0-bce6-3ff4a50b8f45 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Flavor pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 11:58:44.807443 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-e00eff48-f479-4fc0-bce6-3ff4a50b8f45 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Image pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 11:58:44.807996 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-e00eff48-f479-4fc0-bce6-3ff4a50b8f45 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 11:58:44.859519 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e00eff48-f479-4fc0-bce6-3ff4a50b8f45 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:44.863674 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e00eff48-f479-4fc0-bce6-3ff4a50b8f45 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:44.868484 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e00eff48-f479-4fc0-bce6-3ff4a50b8f45 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:44.869904 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e00eff48-f479-4fc0-bce6-3ff4a50b8f45 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:44.963361 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3b604518-b78b-49b4-8f3b-c54ea2e05035 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:44.974915 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3b604518-b78b-49b4-8f3b-c54ea2e05035 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1314 microversion: 2.1 time: 1.226735 Dec 23 11:58:44.976546 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 18/48] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:43 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1314 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:45.005273 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-e00eff48-f479-4fc0-bce6-3ff4a50b8f45 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Getting quotas for project ec59363a116e4c37832626c6add07f04. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 11:58:45.018051 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-e00eff48-f479-4fc0-bce6-3ff4a50b8f45 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Getting quotas for user 3f41f3bd3c1142aca50069a45a26aaaa and project ec59363a116e4c37832626c6add07f04. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 11:58:45.052487 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e00eff48-f479-4fc0-bce6-3ff4a50b8f45 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Going to run 1 instances... {{(pid=116355) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 11:58:45.055686 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e00eff48-f479-4fc0-bce6-3ff4a50b8f45 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='938a78c0-341e-4043-927a-9bfe8cf52508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 11:58:45.246104 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e00eff48-f479-4fc0-bce6-3ff4a50b8f45 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.607694 Dec 23 11:58:45.247227 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 31/49] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 11:58:40 2021] POST /compute/v2.1/servers => generated 383 bytes in 4610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 11:58:45.257803 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9b46ba52-eb0b-466e-9269-525cfe6327d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:45.258964 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9b46ba52-eb0b-466e-9269-525cfe6327d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:45.419993 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9b46ba52-eb0b-466e-9269-525cfe6327d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:45.430078 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9b46ba52-eb0b-466e-9269-525cfe6327d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1221 microversion: 2.1 time: 0.175813 Dec 23 11:58:45.444328 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 19/50] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:45 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1221 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:45.758681 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-25affde9-de2d-431d-895e-490e1c485042 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1971535136", "imageRef": "938a78c0-341e-4043-927a-9bfe8cf52508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b549575c-e737-460e-8224-ff10749539d5"}]}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:58:45.909443 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.network.neutron [None req-25affde9-de2d-431d-895e-490e1c485042 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] validate_networks() for [('b549575c-e737-460e-8224-ff10749539d5', None, None, None, None, None)] {{(pid=116355) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 11:58:45.992974 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4c4f8c0f-a79b-424d-bbf8-33b5d19afd20 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:45.995062 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4c4f8c0f-a79b-424d-bbf8-33b5d19afd20 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:46.008457 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4c4f8c0f-a79b-424d-bbf8-33b5d19afd20 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:46.012221 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4c4f8c0f-a79b-424d-bbf8-33b5d19afd20 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:46.015110 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4c4f8c0f-a79b-424d-bbf8-33b5d19afd20 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:46.016795 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4c4f8c0f-a79b-424d-bbf8-33b5d19afd20 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:47.325870 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4c4f8c0f-a79b-424d-bbf8-33b5d19afd20 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:47.333764 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4c4f8c0f-a79b-424d-bbf8-33b5d19afd20 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1314 microversion: 2.1 time: 1.344991 Dec 23 11:58:47.334350 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 20/51] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:45 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1314 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:58:47.368808 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e14321a0-e0b5-4b4b-b866-e02cc0aa93db tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1473556809", "imageRef": "938a78c0-341e-4043-927a-9bfe8cf52508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ff9bb10-bc99-4d12-bacb-9778f44904da"}], "security_groups": [{"name": "tempest-securitygroup--2073952889"}], "key_name": "tempest-keypair-1574063945", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:58:47.959467 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.network.neutron [None req-e14321a0-e0b5-4b4b-b866-e02cc0aa93db tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] validate_networks() for [('2ff9bb10-bc99-4d12-bacb-9778f44904da', None, None, None, None, None)] {{(pid=116354) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 11:58:49.768211 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-25affde9-de2d-431d-895e-490e1c485042 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Flavor limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 11:58:49.768211 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-25affde9-de2d-431d-895e-490e1c485042 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Image limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 11:58:49.769384 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-25affde9-de2d-431d-895e-490e1c485042 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Flavor pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 11:58:49.769920 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-25affde9-de2d-431d-895e-490e1c485042 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Image pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 11:58:49.770474 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-25affde9-de2d-431d-895e-490e1c485042 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 11:58:49.809674 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-25affde9-de2d-431d-895e-490e1c485042 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:49.813249 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-25affde9-de2d-431d-895e-490e1c485042 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:49.814297 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-25affde9-de2d-431d-895e-490e1c485042 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:49.815210 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-25affde9-de2d-431d-895e-490e1c485042 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:49.860215 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-25affde9-de2d-431d-895e-490e1c485042 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Getting quotas for project ec59363a116e4c37832626c6add07f04. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 11:58:49.873031 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-25affde9-de2d-431d-895e-490e1c485042 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Getting quotas for user 3f41f3bd3c1142aca50069a45a26aaaa and project ec59363a116e4c37832626c6add07f04. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 11:58:49.929365 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-25affde9-de2d-431d-895e-490e1c485042 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Going to run 1 instances... {{(pid=116355) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 11:58:49.931802 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-25affde9-de2d-431d-895e-490e1c485042 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='938a78c0-341e-4043-927a-9bfe8cf52508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 11:58:50.102612 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-25affde9-de2d-431d-895e-490e1c485042 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.348822 Dec 23 11:58:50.109832 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 32/52] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 11:58:45 2021] POST /compute/v2.1/servers => generated 383 bytes in 4359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 11:58:50.116554 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-502ee57f-c978-4c19-996e-48277e49af9b tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:50.118360 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-502ee57f-c978-4c19-996e-48277e49af9b tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:50.127940 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-502ee57f-c978-4c19-996e-48277e49af9b tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:50.128601 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-502ee57f-c978-4c19-996e-48277e49af9b tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:50.129747 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-502ee57f-c978-4c19-996e-48277e49af9b tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:50.130826 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-502ee57f-c978-4c19-996e-48277e49af9b tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:50.658733 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-502ee57f-c978-4c19-996e-48277e49af9b tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:50.669677 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-502ee57f-c978-4c19-996e-48277e49af9b tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1314 microversion: 2.1 time: 0.556198 Dec 23 11:58:50.670291 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 33/53] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:50 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:50.694781 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f19a2bf0-6bc0-46da-a0df-4f4efb465968 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:50.698176 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f19a2bf0-6bc0-46da-a0df-4f4efb465968 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:50.700164 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-e14321a0-e0b5-4b4b-b866-e02cc0aa93db tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Flavor limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 11:58:50.700665 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-e14321a0-e0b5-4b4b-b866-e02cc0aa93db tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Image limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 11:58:50.701030 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-e14321a0-e0b5-4b4b-b866-e02cc0aa93db tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Flavor pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 11:58:50.702193 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-e14321a0-e0b5-4b4b-b866-e02cc0aa93db tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Image pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 11:58:50.702783 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-e14321a0-e0b5-4b4b-b866-e02cc0aa93db tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 11:58:50.721397 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e14321a0-e0b5-4b4b-b866-e02cc0aa93db tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:50.721952 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e14321a0-e0b5-4b4b-b866-e02cc0aa93db tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:50.723393 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e14321a0-e0b5-4b4b-b866-e02cc0aa93db tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:50.728090 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e14321a0-e0b5-4b4b-b866-e02cc0aa93db tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:50.785865 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-e14321a0-e0b5-4b4b-b866-e02cc0aa93db tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Getting quotas for project e6c655658b5f4f53b4145ea20afcf1d4. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 11:58:50.785865 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-e14321a0-e0b5-4b4b-b866-e02cc0aa93db tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Getting quotas for user 804530daa2704fcdb1fef91615b62c99 and project e6c655658b5f4f53b4145ea20afcf1d4. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 11:58:50.833555 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e14321a0-e0b5-4b4b-b866-e02cc0aa93db tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Going to run 1 instances... {{(pid=116354) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 11:58:50.847185 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e14321a0-e0b5-4b4b-b866-e02cc0aa93db tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='938a78c0-341e-4043-927a-9bfe8cf52508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 11:58:50.879637 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-f19a2bf0-6bc0-46da-a0df-4f4efb465968 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:50.891587 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f19a2bf0-6bc0-46da-a0df-4f4efb465968 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1222 microversion: 2.1 time: 0.216676 Dec 23 11:58:50.892384 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 34/54] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:50 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1222 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:51.019549 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e14321a0-e0b5-4b4b-b866-e02cc0aa93db tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.673566 Dec 23 11:58:51.028096 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 21/55] 10.222.0.65 () {62 vars in 1187 bytes} [Thu Dec 23 11:58:47 2021] POST /compute/v2.1/servers => generated 402 bytes in 3683 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 23 11:58:51.061443 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-021b63c3-5e06-44a5-a74b-69fa231afa45 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:51.062097 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-021b63c3-5e06-44a5-a74b-69fa231afa45 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:51.226674 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-021b63c3-5e06-44a5-a74b-69fa231afa45 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:51.275385 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-021b63c3-5e06-44a5-a74b-69fa231afa45 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:51.287425 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-021b63c3-5e06-44a5-a74b-69fa231afa45 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:51.288998 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-021b63c3-5e06-44a5-a74b-69fa231afa45 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1282 microversion: 2.20 time: 0.249770 Dec 23 11:58:51.293668 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 22/56] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:58:51 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1282 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:58:51.419799 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-2a463483-3df0-46ff-9dc7-bf726c84d5bc req-f90b21bf-759d-4464-bad2-8966b60f31d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "518c84e9-aab7-44b1-b614-30ffee393824", "tag": "22f1c7ad-1474-4ad8-9cfd-7bcc25d1951a"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:58:51.422286 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:58:51.422286 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 11:58:51.459016 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-2a463483-3df0-46ff-9dc7-bf726c84d5bc req-f90b21bf-759d-4464-bad2-8966b60f31d6 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:51.480683 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-2a463483-3df0-46ff-9dc7-bf726c84d5bc req-f90b21bf-759d-4464-bad2-8966b60f31d6 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:51.551172 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-2a463483-3df0-46ff-9dc7-bf726c84d5bc req-f90b21bf-759d-4464-bad2-8966b60f31d6 service nova] Creating event network-changed:22f1c7ad-1474-4ad8-9cfd-7bcc25d1951a for instance 518c84e9-aab7-44b1-b614-30ffee393824 on hv-cinder-82282 Dec 23 11:58:51.551746 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-2a463483-3df0-46ff-9dc7-bf726c84d5bc req-f90b21bf-759d-4464-bad2-8966b60f31d6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 23 11:58:51.558213 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1b3526b9-3195-4462-a821-508e34e9860f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:51.558953 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1b3526b9-3195-4462-a821-508e34e9860f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:51.560020 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1b3526b9-3195-4462-a821-508e34e9860f None None] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:51.562838 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1b3526b9-3195-4462-a821-508e34e9860f None None] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:51.611452 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.compute.rpcapi [None req-1b3526b9-3195-4462-a821-508e34e9860f None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 23 11:58:51.613502 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1b3526b9-3195-4462-a821-508e34e9860f None None] Releasing lock "compute-rpcapi-router" {{(pid=116355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 23 11:58:51.658246 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-1b3526b9-3195-4462-a821-508e34e9860f None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.763808 Dec 23 11:58:51.659160 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 35/57] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 11:58:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:58:51.691297 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a6ccc8bc-5460-468f-8f0e-0325eab96282 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:51.703758 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a6ccc8bc-5460-468f-8f0e-0325eab96282 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:51.718456 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a6ccc8bc-5460-468f-8f0e-0325eab96282 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:51.718971 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a6ccc8bc-5460-468f-8f0e-0325eab96282 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:51.733676 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a6ccc8bc-5460-468f-8f0e-0325eab96282 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:51.733676 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a6ccc8bc-5460-468f-8f0e-0325eab96282 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:51.909548 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-1874eb37-3bf9-4d23-bbd5-23004252d39c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:51.910370 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-1874eb37-3bf9-4d23-bbd5-23004252d39c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:51.920919 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1874eb37-3bf9-4d23-bbd5-23004252d39c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:51.923298 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1874eb37-3bf9-4d23-bbd5-23004252d39c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:51.924390 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1874eb37-3bf9-4d23-bbd5-23004252d39c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:51.924836 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1874eb37-3bf9-4d23-bbd5-23004252d39c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:51.933810 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-a6ccc8bc-5460-468f-8f0e-0325eab96282 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:51.950646 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a6ccc8bc-5460-468f-8f0e-0325eab96282 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1314 microversion: 2.1 time: 0.262366 Dec 23 11:58:51.960234 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 23/58] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:51 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:52.061325 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-1874eb37-3bf9-4d23-bbd5-23004252d39c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:52.069883 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-1874eb37-3bf9-4d23-bbd5-23004252d39c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1226 microversion: 2.1 time: 0.165155 Dec 23 11:58:52.070477 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 36/59] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:51 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1226 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:52.311997 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c29b9a0e-8e56-427e-90b4-37a3bb89a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:52.312696 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c29b9a0e-8e56-427e-90b4-37a3bb89a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:52.320375 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c29b9a0e-8e56-427e-90b4-37a3bb89a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:52.320970 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c29b9a0e-8e56-427e-90b4-37a3bb89a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:52.321879 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c29b9a0e-8e56-427e-90b4-37a3bb89a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:52.322435 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c29b9a0e-8e56-427e-90b4-37a3bb89a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:52.447648 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c29b9a0e-8e56-427e-90b4-37a3bb89a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:52.467757 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c29b9a0e-8e56-427e-90b4-37a3bb89a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:52.469513 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c29b9a0e-8e56-427e-90b4-37a3bb89a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:52.470633 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c29b9a0e-8e56-427e-90b4-37a3bb89a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1286 microversion: 2.20 time: 0.163335 Dec 23 11:58:52.482969 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 24/60] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:58:52 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:58:52.969259 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8a7e9c9f-fd95-4965-9bd1-6d03d0b1b0c1 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:52.970749 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-8a7e9c9f-fd95-4965-9bd1-6d03d0b1b0c1 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:52.991724 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8a7e9c9f-fd95-4965-9bd1-6d03d0b1b0c1 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:52.992648 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8a7e9c9f-fd95-4965-9bd1-6d03d0b1b0c1 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:52.993526 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8a7e9c9f-fd95-4965-9bd1-6d03d0b1b0c1 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:52.994147 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8a7e9c9f-fd95-4965-9bd1-6d03d0b1b0c1 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:53.089611 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-fdc4e5b2-35b0-4a72-ac93-926ee46e0a35 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:53.097553 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-fdc4e5b2-35b0-4a72-ac93-926ee46e0a35 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:53.116104 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fdc4e5b2-35b0-4a72-ac93-926ee46e0a35 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:53.120883 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fdc4e5b2-35b0-4a72-ac93-926ee46e0a35 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:53.124452 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fdc4e5b2-35b0-4a72-ac93-926ee46e0a35 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:53.125037 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fdc4e5b2-35b0-4a72-ac93-926ee46e0a35 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:53.159084 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-8a7e9c9f-fd95-4965-9bd1-6d03d0b1b0c1 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:53.175048 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-8a7e9c9f-fd95-4965-9bd1-6d03d0b1b0c1 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1314 microversion: 2.1 time: 0.209953 Dec 23 11:58:53.176041 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 37/61] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:52 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:53.234742 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-fdc4e5b2-35b0-4a72-ac93-926ee46e0a35 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:53.244293 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-fdc4e5b2-35b0-4a72-ac93-926ee46e0a35 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1226 microversion: 2.1 time: 0.158052 Dec 23 11:58:53.249397 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 25/62] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:53 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1226 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:53.492936 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2e21e884-1863-439a-bf5f-cc2fa6f9099e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:53.499047 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2e21e884-1863-439a-bf5f-cc2fa6f9099e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:53.517435 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2e21e884-1863-439a-bf5f-cc2fa6f9099e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:53.517884 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2e21e884-1863-439a-bf5f-cc2fa6f9099e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:53.518719 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2e21e884-1863-439a-bf5f-cc2fa6f9099e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:53.519168 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2e21e884-1863-439a-bf5f-cc2fa6f9099e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:53.650300 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-2e21e884-1863-439a-bf5f-cc2fa6f9099e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:53.658825 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-2e21e884-1863-439a-bf5f-cc2fa6f9099e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:53.661078 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-2e21e884-1863-439a-bf5f-cc2fa6f9099e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:53.662379 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2e21e884-1863-439a-bf5f-cc2fa6f9099e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1286 microversion: 2.20 time: 0.176104 Dec 23 11:58:53.663584 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 38/63] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:58:53 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1286 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:58:54.194331 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1ed89ba7-2eca-446e-8b88-6e58d6a6aecd tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:54.194976 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1ed89ba7-2eca-446e-8b88-6e58d6a6aecd tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:54.203812 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1ed89ba7-2eca-446e-8b88-6e58d6a6aecd tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:54.204278 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1ed89ba7-2eca-446e-8b88-6e58d6a6aecd tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:54.205086 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1ed89ba7-2eca-446e-8b88-6e58d6a6aecd tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:54.205523 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1ed89ba7-2eca-446e-8b88-6e58d6a6aecd tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:54.271181 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-041f7998-c93e-41a0-b6bc-e212f506a76d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:54.272428 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-041f7998-c93e-41a0-b6bc-e212f506a76d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:54.281084 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-041f7998-c93e-41a0-b6bc-e212f506a76d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:54.287518 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-041f7998-c93e-41a0-b6bc-e212f506a76d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:54.288702 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-041f7998-c93e-41a0-b6bc-e212f506a76d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:54.289298 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-041f7998-c93e-41a0-b6bc-e212f506a76d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:54.399928 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-041f7998-c93e-41a0-b6bc-e212f506a76d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:54.409945 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-041f7998-c93e-41a0-b6bc-e212f506a76d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1226 microversion: 2.1 time: 0.149042 Dec 23 11:58:54.419568 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 39/64] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:54 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1226 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:54.562318 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1ed89ba7-2eca-446e-8b88-6e58d6a6aecd tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:54.577513 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1ed89ba7-2eca-446e-8b88-6e58d6a6aecd tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1314 microversion: 2.1 time: 0.387932 Dec 23 11:58:54.578715 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 26/65] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:54 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:54.680273 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e633ee59-fe32-4029-ba0a-6a16d5492ea4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:54.682323 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e633ee59-fe32-4029-ba0a-6a16d5492ea4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:54.693060 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e633ee59-fe32-4029-ba0a-6a16d5492ea4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:54.693847 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e633ee59-fe32-4029-ba0a-6a16d5492ea4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:54.698237 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e633ee59-fe32-4029-ba0a-6a16d5492ea4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:54.699115 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e633ee59-fe32-4029-ba0a-6a16d5492ea4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:54.830592 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e633ee59-fe32-4029-ba0a-6a16d5492ea4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:54.841998 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e633ee59-fe32-4029-ba0a-6a16d5492ea4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:54.843655 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e633ee59-fe32-4029-ba0a-6a16d5492ea4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:54.845224 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e633ee59-fe32-4029-ba0a-6a16d5492ea4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1286 microversion: 2.20 time: 0.168987 Dec 23 11:58:54.846089 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 40/66] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:58:54 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1286 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:58:55.428624 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b0bd4572-3594-465a-b304-e1877ca1f761 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:55.429883 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b0bd4572-3594-465a-b304-e1877ca1f761 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:55.439876 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b0bd4572-3594-465a-b304-e1877ca1f761 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:55.440648 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b0bd4572-3594-465a-b304-e1877ca1f761 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:55.441687 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b0bd4572-3594-465a-b304-e1877ca1f761 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:55.446563 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b0bd4572-3594-465a-b304-e1877ca1f761 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:55.595801 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-b0bd4572-3594-465a-b304-e1877ca1f761 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:55.599640 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d6858aed-a1e2-44d7-9b4f-504628970704 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:55.602293 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d6858aed-a1e2-44d7-9b4f-504628970704 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:55.609504 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b0bd4572-3594-465a-b304-e1877ca1f761 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1274 microversion: 2.1 time: 0.185249 Dec 23 11:58:55.613338 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d6858aed-a1e2-44d7-9b4f-504628970704 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:55.614137 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 27/67] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:55 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1274 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:55.614769 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d6858aed-a1e2-44d7-9b4f-504628970704 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:55.615733 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d6858aed-a1e2-44d7-9b4f-504628970704 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:55.616310 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d6858aed-a1e2-44d7-9b4f-504628970704 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:55.865030 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8b809d5e-631e-48ce-8935-a5e49ed666a7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:55.865795 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8b809d5e-631e-48ce-8935-a5e49ed666a7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:55.876449 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8b809d5e-631e-48ce-8935-a5e49ed666a7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:55.877948 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8b809d5e-631e-48ce-8935-a5e49ed666a7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:55.879841 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8b809d5e-631e-48ce-8935-a5e49ed666a7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:55.882250 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8b809d5e-631e-48ce-8935-a5e49ed666a7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:56.016875 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8b809d5e-631e-48ce-8935-a5e49ed666a7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:56.030354 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8b809d5e-631e-48ce-8935-a5e49ed666a7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:56.032689 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8b809d5e-631e-48ce-8935-a5e49ed666a7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:56.041130 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8b809d5e-631e-48ce-8935-a5e49ed666a7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1278 microversion: 2.20 time: 0.178284 Dec 23 11:58:56.044107 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 28/68] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:58:55 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:58:56.574038 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d6858aed-a1e2-44d7-9b4f-504628970704 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:56.582842 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d6858aed-a1e2-44d7-9b4f-504628970704 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1314 microversion: 2.1 time: 0.992109 Dec 23 11:58:56.590114 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 41/69] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:55 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1314 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:56.636388 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0b039e29-cd90-433b-bd8a-8852e2447757 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:56.638778 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0b039e29-cd90-433b-bd8a-8852e2447757 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:56.649793 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0b039e29-cd90-433b-bd8a-8852e2447757 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:56.650233 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0b039e29-cd90-433b-bd8a-8852e2447757 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:56.651073 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0b039e29-cd90-433b-bd8a-8852e2447757 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:56.651531 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0b039e29-cd90-433b-bd8a-8852e2447757 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:56.845801 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0b039e29-cd90-433b-bd8a-8852e2447757 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:56.859887 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0b039e29-cd90-433b-bd8a-8852e2447757 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1280 microversion: 2.1 time: 0.230837 Dec 23 11:58:56.862422 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 29/70] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:56 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1280 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:57.061710 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b646a921-8e4a-4393-9df6-4644359ef6ab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:57.063066 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b646a921-8e4a-4393-9df6-4644359ef6ab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:57.076343 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b646a921-8e4a-4393-9df6-4644359ef6ab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:57.076808 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b646a921-8e4a-4393-9df6-4644359ef6ab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:57.077605 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b646a921-8e4a-4393-9df6-4644359ef6ab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:57.078434 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b646a921-8e4a-4393-9df6-4644359ef6ab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:57.214474 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b646a921-8e4a-4393-9df6-4644359ef6ab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:57.222954 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b646a921-8e4a-4393-9df6-4644359ef6ab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:57.224891 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b646a921-8e4a-4393-9df6-4644359ef6ab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:57.226882 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b646a921-8e4a-4393-9df6-4644359ef6ab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1340 microversion: 2.20 time: 0.170247 Dec 23 11:58:57.228171 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 42/71] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:58:57 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1340 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:58:57.607135 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ec084b06-125a-49af-97bd-e753adecbeeb tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:57.607927 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ec084b06-125a-49af-97bd-e753adecbeeb tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:57.620688 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ec084b06-125a-49af-97bd-e753adecbeeb tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:57.621228 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ec084b06-125a-49af-97bd-e753adecbeeb tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:57.622238 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ec084b06-125a-49af-97bd-e753adecbeeb tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:57.622496 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ec084b06-125a-49af-97bd-e753adecbeeb tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:57.877973 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e08c768b-62ab-4079-afc1-918df757e840 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:57.878642 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e08c768b-62ab-4079-afc1-918df757e840 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:57.891464 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e08c768b-62ab-4079-afc1-918df757e840 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:57.891952 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e08c768b-62ab-4079-afc1-918df757e840 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:57.896188 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e08c768b-62ab-4079-afc1-918df757e840 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:57.896665 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e08c768b-62ab-4079-afc1-918df757e840 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:58.053090 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e08c768b-62ab-4079-afc1-918df757e840 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:58.062860 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e08c768b-62ab-4079-afc1-918df757e840 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1280 microversion: 2.1 time: 0.188942 Dec 23 11:58:58.074054 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 43/72] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:57 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1280 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:58.184853 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ec084b06-125a-49af-97bd-e753adecbeeb tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:58.192507 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ec084b06-125a-49af-97bd-e753adecbeeb tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1314 microversion: 2.1 time: 0.590341 Dec 23 11:58:58.201904 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 30/73] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:57 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:58.247533 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4b227405-798a-4e95-bd33-0f3059661e97 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:58.248281 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4b227405-798a-4e95-bd33-0f3059661e97 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:58.258783 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4b227405-798a-4e95-bd33-0f3059661e97 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:58.259387 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4b227405-798a-4e95-bd33-0f3059661e97 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:58.261856 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4b227405-798a-4e95-bd33-0f3059661e97 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:58.263628 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4b227405-798a-4e95-bd33-0f3059661e97 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:58.434571 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4b227405-798a-4e95-bd33-0f3059661e97 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:58.444342 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4b227405-798a-4e95-bd33-0f3059661e97 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:58.446408 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4b227405-798a-4e95-bd33-0f3059661e97 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:58.447809 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4b227405-798a-4e95-bd33-0f3059661e97 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1340 microversion: 2.20 time: 0.205083 Dec 23 11:58:58.448422 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 44/74] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:58:58 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1340 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:58:59.081209 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8d7c3c64-ac77-45e0-81f7-8f3c6962cc01 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:59.081823 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8d7c3c64-ac77-45e0-81f7-8f3c6962cc01 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:59.098084 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d7c3c64-ac77-45e0-81f7-8f3c6962cc01 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:59.098599 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d7c3c64-ac77-45e0-81f7-8f3c6962cc01 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:59.099399 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d7c3c64-ac77-45e0-81f7-8f3c6962cc01 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:59.099836 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d7c3c64-ac77-45e0-81f7-8f3c6962cc01 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:59.207424 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8d7c3c64-ac77-45e0-81f7-8f3c6962cc01 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:59.209471 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c30b8c39-60d6-4072-b630-f83f3ac790d9 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:59.210079 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c30b8c39-60d6-4072-b630-f83f3ac790d9 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:59.216488 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8d7c3c64-ac77-45e0-81f7-8f3c6962cc01 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1280 microversion: 2.1 time: 0.138740 Dec 23 11:58:59.228061 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 31/75] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:59 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1280 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:58:59.229941 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c30b8c39-60d6-4072-b630-f83f3ac790d9 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:59.230432 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c30b8c39-60d6-4072-b630-f83f3ac790d9 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:59.231485 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c30b8c39-60d6-4072-b630-f83f3ac790d9 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:59.232292 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c30b8c39-60d6-4072-b630-f83f3ac790d9 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:59.467148 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4f35fa5a-1bd6-49af-b99b-94a2bb90b978 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:58:59.467961 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4f35fa5a-1bd6-49af-b99b-94a2bb90b978 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:58:59.479028 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4f35fa5a-1bd6-49af-b99b-94a2bb90b978 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:59.480953 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4f35fa5a-1bd6-49af-b99b-94a2bb90b978 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:59.490730 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4f35fa5a-1bd6-49af-b99b-94a2bb90b978 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:58:59.491287 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4f35fa5a-1bd6-49af-b99b-94a2bb90b978 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:58:59.621733 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4f35fa5a-1bd6-49af-b99b-94a2bb90b978 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:59.634557 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4f35fa5a-1bd6-49af-b99b-94a2bb90b978 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:59.637415 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4f35fa5a-1bd6-49af-b99b-94a2bb90b978 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:59.639496 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4f35fa5a-1bd6-49af-b99b-94a2bb90b978 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1340 microversion: 2.20 time: 0.178066 Dec 23 11:58:59.645599 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 32/76] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:58:59 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1340 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 11:58:59.773312 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c30b8c39-60d6-4072-b630-f83f3ac790d9 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:58:59.786600 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c30b8c39-60d6-4072-b630-f83f3ac790d9 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1314 microversion: 2.1 time: 0.578510 Dec 23 11:58:59.787279 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 45/77] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:58:59 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:00.246551 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c559babc-f3f5-444c-80cd-aa51e30f4cee tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:00.249189 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c559babc-f3f5-444c-80cd-aa51e30f4cee tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:00.259296 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c559babc-f3f5-444c-80cd-aa51e30f4cee tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:00.261567 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c559babc-f3f5-444c-80cd-aa51e30f4cee tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:00.262703 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c559babc-f3f5-444c-80cd-aa51e30f4cee tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:00.263347 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c559babc-f3f5-444c-80cd-aa51e30f4cee tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:00.667613 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-51b2cb6a-1b58-4d28-8654-03162c904793 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:00.670648 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-51b2cb6a-1b58-4d28-8654-03162c904793 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:00.682172 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-51b2cb6a-1b58-4d28-8654-03162c904793 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:00.683138 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-51b2cb6a-1b58-4d28-8654-03162c904793 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:00.689229 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-51b2cb6a-1b58-4d28-8654-03162c904793 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:00.690090 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-51b2cb6a-1b58-4d28-8654-03162c904793 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:00.983426 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c559babc-f3f5-444c-80cd-aa51e30f4cee tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:00.993188 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c559babc-f3f5-444c-80cd-aa51e30f4cee tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1322 microversion: 2.1 time: 0.759468 Dec 23 11:59:00.993766 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 33/78] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:00 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1322 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:01.010762 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-03aff7df-2144-43a5-934a-789e4b5f4e8d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:01.012131 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-03aff7df-2144-43a5-934a-789e4b5f4e8d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:01.028886 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-03aff7df-2144-43a5-934a-789e4b5f4e8d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:01.030719 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-03aff7df-2144-43a5-934a-789e4b5f4e8d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:01.036287 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-03aff7df-2144-43a5-934a-789e4b5f4e8d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:01.037960 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-03aff7df-2144-43a5-934a-789e4b5f4e8d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:01.390219 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-51b2cb6a-1b58-4d28-8654-03162c904793 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:01.411086 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-51b2cb6a-1b58-4d28-8654-03162c904793 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:01.414608 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-51b2cb6a-1b58-4d28-8654-03162c904793 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:01.422921 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-51b2cb6a-1b58-4d28-8654-03162c904793 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1408 microversion: 2.20 time: 0.757198 Dec 23 11:59:01.433697 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 46/79] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:00 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1408 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:59:01.652275 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-1ff5082f-63dc-46ba-8170-c2e6212a1e51 req-bc750899-4bbe-489d-b7e9-592ed7e4c119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15f88906-0a5f-47a4-bf35-55db395a0e97", "tag": "b32d0851-1880-4e36-81d6-464702876f58"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:01.654107 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:59:01.654107 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 11:59:01.667773 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-1ff5082f-63dc-46ba-8170-c2e6212a1e51 req-bc750899-4bbe-489d-b7e9-592ed7e4c119 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:01.669054 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-1ff5082f-63dc-46ba-8170-c2e6212a1e51 req-bc750899-4bbe-489d-b7e9-592ed7e4c119 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:01.693425 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-1ff5082f-63dc-46ba-8170-c2e6212a1e51 req-bc750899-4bbe-489d-b7e9-592ed7e4c119 service nova] Creating event network-changed:b32d0851-1880-4e36-81d6-464702876f58 for instance 15f88906-0a5f-47a4-bf35-55db395a0e97 on hv-cinder-82282 Dec 23 11:59:01.709272 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-1ff5082f-63dc-46ba-8170-c2e6212a1e51 req-bc750899-4bbe-489d-b7e9-592ed7e4c119 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060694 Dec 23 11:59:01.710410 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 47/80] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 11:59:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:59:01.746322 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-03aff7df-2144-43a5-934a-789e4b5f4e8d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:01.756224 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-03aff7df-2144-43a5-934a-789e4b5f4e8d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1314 microversion: 2.1 time: 0.760078 Dec 23 11:59:01.767399 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 34/81] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:00 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:02.012735 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f282201d-bb2c-44d0-8096-2d991bb74d40 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:02.014039 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f282201d-bb2c-44d0-8096-2d991bb74d40 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:02.024789 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f282201d-bb2c-44d0-8096-2d991bb74d40 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:02.025551 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f282201d-bb2c-44d0-8096-2d991bb74d40 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:02.027989 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f282201d-bb2c-44d0-8096-2d991bb74d40 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:02.029862 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f282201d-bb2c-44d0-8096-2d991bb74d40 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:02.442623 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b2f15051-54ba-4669-b51a-7b0efdb1471c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:02.443330 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b2f15051-54ba-4669-b51a-7b0efdb1471c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:02.463067 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b2f15051-54ba-4669-b51a-7b0efdb1471c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:02.463546 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b2f15051-54ba-4669-b51a-7b0efdb1471c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:02.473844 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b2f15051-54ba-4669-b51a-7b0efdb1471c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:02.474315 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b2f15051-54ba-4669-b51a-7b0efdb1471c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:03.243178 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-f282201d-bb2c-44d0-8096-2d991bb74d40 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:03.257217 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f282201d-bb2c-44d0-8096-2d991bb74d40 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1322 microversion: 2.1 time: 1.249736 Dec 23 11:59:03.257836 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 48/82] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:02 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1322 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:03.273257 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a47e2b94-6130-4d91-899a-5df40d3e8f45 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:03.273968 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a47e2b94-6130-4d91-899a-5df40d3e8f45 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:03.304964 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a47e2b94-6130-4d91-899a-5df40d3e8f45 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:03.305438 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a47e2b94-6130-4d91-899a-5df40d3e8f45 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:03.311208 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a47e2b94-6130-4d91-899a-5df40d3e8f45 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:03.311748 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a47e2b94-6130-4d91-899a-5df40d3e8f45 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:03.418734 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-b2f15051-54ba-4669-b51a-7b0efdb1471c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:03.431594 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-b2f15051-54ba-4669-b51a-7b0efdb1471c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:03.433431 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-b2f15051-54ba-4669-b51a-7b0efdb1471c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:03.434866 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b2f15051-54ba-4669-b51a-7b0efdb1471c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1408 microversion: 2.20 time: 0.997024 Dec 23 11:59:03.448320 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 35/83] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:02 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1408 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:59:03.732672 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-3cfcdffa-6a77-481b-8d9a-f5183fb0dab4 req-77db5bc5-88d1-4602-9b83-e78d44b6db68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1c78f6c-0393-44fa-8edd-0fe5cc257d7f", "tag": "4c211a14-71cd-421b-8af4-29651931f338"}, {"name": "network-changed", "server_uuid": "fc998144-5288-467f-82de-9c1983559e40", "tag": "bbf34ca1-ab1a-4521-9402-ff6d335fe55a"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:03.736327 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:59:03.736327 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 11:59:03.760454 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-3cfcdffa-6a77-481b-8d9a-f5183fb0dab4 req-77db5bc5-88d1-4602-9b83-e78d44b6db68 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:03.761105 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-3cfcdffa-6a77-481b-8d9a-f5183fb0dab4 req-77db5bc5-88d1-4602-9b83-e78d44b6db68 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:03.802242 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-3cfcdffa-6a77-481b-8d9a-f5183fb0dab4 req-77db5bc5-88d1-4602-9b83-e78d44b6db68 service nova] Creating event network-changed:4c211a14-71cd-421b-8af4-29651931f338 for instance f1c78f6c-0393-44fa-8edd-0fe5cc257d7f on hv-cinder-82282 Dec 23 11:59:03.806461 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-3cfcdffa-6a77-481b-8d9a-f5183fb0dab4 req-77db5bc5-88d1-4602-9b83-e78d44b6db68 service nova] Creating event network-changed:bbf34ca1-ab1a-4521-9402-ff6d335fe55a for instance fc998144-5288-467f-82de-9c1983559e40 on hv-cinder-82282 Dec 23 11:59:03.807494 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-3cfcdffa-6a77-481b-8d9a-f5183fb0dab4 req-77db5bc5-88d1-4602-9b83-e78d44b6db68 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 23 11:59:03.809611 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-137ef0f8-639e-47f5-b2da-f446732f058c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:03.810269 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-137ef0f8-639e-47f5-b2da-f446732f058c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:03.811369 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-137ef0f8-639e-47f5-b2da-f446732f058c None None] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:03.811998 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-137ef0f8-639e-47f5-b2da-f446732f058c None None] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:03.824987 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.compute.rpcapi [None req-137ef0f8-639e-47f5-b2da-f446732f058c None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 23 11:59:03.826062 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-137ef0f8-639e-47f5-b2da-f446732f058c None None] Releasing lock "compute-rpcapi-router" {{(pid=116354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 23 11:59:03.870780 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-137ef0f8-639e-47f5-b2da-f446732f058c None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.139548 Dec 23 11:59:03.873631 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 36/84] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 11:59:03 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 11:59:04.001298 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a47e2b94-6130-4d91-899a-5df40d3e8f45 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:04.011372 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a47e2b94-6130-4d91-899a-5df40d3e8f45 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1314 microversion: 2.1 time: 0.752371 Dec 23 11:59:04.012407 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 49/85] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:03 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:04.240661 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-930ee983-c24d-4910-90b3-8085ffd1400e req-3d22f36e-dcf4-441a-8e2d-e06dc35fb051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "518c84e9-aab7-44b1-b614-30ffee393824", "name": "network-vif-plugged", "status": "completed", "tag": "22f1c7ad-1474-4ad8-9cfd-7bcc25d1951a"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:04.242200 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:59:04.242200 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 11:59:04.258019 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-930ee983-c24d-4910-90b3-8085ffd1400e req-3d22f36e-dcf4-441a-8e2d-e06dc35fb051 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:04.258565 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-930ee983-c24d-4910-90b3-8085ffd1400e req-3d22f36e-dcf4-441a-8e2d-e06dc35fb051 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:04.276838 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-575b076d-baf6-4192-a906-821b7b4d1222 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:04.277305 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-575b076d-baf6-4192-a906-821b7b4d1222 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:04.294327 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-575b076d-baf6-4192-a906-821b7b4d1222 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:04.294943 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-575b076d-baf6-4192-a906-821b7b4d1222 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:04.295414 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-930ee983-c24d-4910-90b3-8085ffd1400e req-3d22f36e-dcf4-441a-8e2d-e06dc35fb051 service nova] Creating event network-vif-plugged:22f1c7ad-1474-4ad8-9cfd-7bcc25d1951a for instance 518c84e9-aab7-44b1-b614-30ffee393824 on hv-cinder-82282 Dec 23 11:59:04.296416 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-575b076d-baf6-4192-a906-821b7b4d1222 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:04.296864 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-575b076d-baf6-4192-a906-821b7b4d1222 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:04.301778 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-930ee983-c24d-4910-90b3-8085ffd1400e req-3d22f36e-dcf4-441a-8e2d-e06dc35fb051 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264417 Dec 23 11:59:04.303151 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 37/86] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 11:59:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:59:04.454307 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-70eaa11c-ad20-466e-b263-1fb488e7eac4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:04.455203 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-70eaa11c-ad20-466e-b263-1fb488e7eac4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:04.468624 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-70eaa11c-ad20-466e-b263-1fb488e7eac4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:04.469234 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-70eaa11c-ad20-466e-b263-1fb488e7eac4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:04.470279 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-70eaa11c-ad20-466e-b263-1fb488e7eac4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:04.470865 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-70eaa11c-ad20-466e-b263-1fb488e7eac4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:05.099471 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-575b076d-baf6-4192-a906-821b7b4d1222 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:05.109979 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-575b076d-baf6-4192-a906-821b7b4d1222 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1322 microversion: 2.1 time: 0.835173 Dec 23 11:59:05.111456 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 50/87] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:04 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1322 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:05.124191 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ebf0009d-5d0c-4fbb-a285-d4a31ce414ae tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:05.126679 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ebf0009d-5d0c-4fbb-a285-d4a31ce414ae tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:05.141572 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ebf0009d-5d0c-4fbb-a285-d4a31ce414ae tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:05.147898 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ebf0009d-5d0c-4fbb-a285-d4a31ce414ae tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:05.149519 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ebf0009d-5d0c-4fbb-a285-d4a31ce414ae tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:05.150803 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ebf0009d-5d0c-4fbb-a285-d4a31ce414ae tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:05.255151 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-70eaa11c-ad20-466e-b263-1fb488e7eac4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:05.283854 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-70eaa11c-ad20-466e-b263-1fb488e7eac4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:05.287744 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-70eaa11c-ad20-466e-b263-1fb488e7eac4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:05.291611 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-70eaa11c-ad20-466e-b263-1fb488e7eac4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1408 microversion: 2.20 time: 0.841234 Dec 23 11:59:05.299324 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 38/88] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:04 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1408 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:59:05.666992 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ebf0009d-5d0c-4fbb-a285-d4a31ce414ae tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:05.677538 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ebf0009d-5d0c-4fbb-a285-d4a31ce414ae tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1314 microversion: 2.1 time: 0.563087 Dec 23 11:59:05.678853 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 51/89] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:05 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:06.128605 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-88c95f29-45c3-46e9-b6de-449076d7e193 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:06.130258 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-88c95f29-45c3-46e9-b6de-449076d7e193 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:06.136613 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-88c95f29-45c3-46e9-b6de-449076d7e193 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:06.137358 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-88c95f29-45c3-46e9-b6de-449076d7e193 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:06.139199 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-88c95f29-45c3-46e9-b6de-449076d7e193 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:06.139943 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-88c95f29-45c3-46e9-b6de-449076d7e193 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:06.324816 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3b16567b-de69-4b27-b9e1-1b53df0e6589 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:06.325439 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3b16567b-de69-4b27-b9e1-1b53df0e6589 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:06.335959 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3b16567b-de69-4b27-b9e1-1b53df0e6589 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:06.336661 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3b16567b-de69-4b27-b9e1-1b53df0e6589 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:06.337690 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3b16567b-de69-4b27-b9e1-1b53df0e6589 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:06.338299 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3b16567b-de69-4b27-b9e1-1b53df0e6589 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:06.353160 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-88c95f29-45c3-46e9-b6de-449076d7e193 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:06.362567 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-88c95f29-45c3-46e9-b6de-449076d7e193 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1322 microversion: 2.1 time: 0.237741 Dec 23 11:59:06.378545 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 39/90] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:06 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:06.601228 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3b16567b-de69-4b27-b9e1-1b53df0e6589 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:06.609566 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3b16567b-de69-4b27-b9e1-1b53df0e6589 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:06.611364 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3b16567b-de69-4b27-b9e1-1b53df0e6589 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:06.612978 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3b16567b-de69-4b27-b9e1-1b53df0e6589 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1408 microversion: 2.20 time: 0.292168 Dec 23 11:59:06.624232 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 52/91] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:06 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1408 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:59:06.697279 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ca29a016-4dd0-479d-a5c4-586e59af0655 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:06.697892 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ca29a016-4dd0-479d-a5c4-586e59af0655 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:06.707846 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ca29a016-4dd0-479d-a5c4-586e59af0655 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:06.708291 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ca29a016-4dd0-479d-a5c4-586e59af0655 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:06.711195 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ca29a016-4dd0-479d-a5c4-586e59af0655 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:06.712056 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ca29a016-4dd0-479d-a5c4-586e59af0655 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:07.110272 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ca29a016-4dd0-479d-a5c4-586e59af0655 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:07.122402 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ca29a016-4dd0-479d-a5c4-586e59af0655 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1314 microversion: 2.1 time: 0.430133 Dec 23 11:59:07.127088 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 40/92] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:06 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:07.424733 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-491b995e-3fa3-4094-b57d-21075d6e7dea tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:07.426121 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-491b995e-3fa3-4094-b57d-21075d6e7dea tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:07.433668 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-491b995e-3fa3-4094-b57d-21075d6e7dea tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:07.434394 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-491b995e-3fa3-4094-b57d-21075d6e7dea tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:07.435505 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-491b995e-3fa3-4094-b57d-21075d6e7dea tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:07.435984 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-491b995e-3fa3-4094-b57d-21075d6e7dea tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:07.633015 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-45e54319-2075-4dfb-8d3c-e78ac7d3d0af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:07.634230 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-45e54319-2075-4dfb-8d3c-e78ac7d3d0af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:07.643362 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-45e54319-2075-4dfb-8d3c-e78ac7d3d0af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:07.644635 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-45e54319-2075-4dfb-8d3c-e78ac7d3d0af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:07.645783 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-45e54319-2075-4dfb-8d3c-e78ac7d3d0af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:07.646584 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-45e54319-2075-4dfb-8d3c-e78ac7d3d0af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:07.672135 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-491b995e-3fa3-4094-b57d-21075d6e7dea tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:07.681410 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-491b995e-3fa3-4094-b57d-21075d6e7dea tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1322 microversion: 2.1 time: 0.260566 Dec 23 11:59:07.682159 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 53/93] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:07 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:07.804521 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-45e54319-2075-4dfb-8d3c-e78ac7d3d0af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:07.814028 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-45e54319-2075-4dfb-8d3c-e78ac7d3d0af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:07.816166 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-45e54319-2075-4dfb-8d3c-e78ac7d3d0af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:07.817740 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-45e54319-2075-4dfb-8d3c-e78ac7d3d0af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1408 microversion: 2.20 time: 0.189352 Dec 23 11:59:07.819531 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 41/94] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:07 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 11:59:08.143140 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-fdda31e2-c1bc-4c05-ace8-f07f0f6942aa tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:08.144379 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-fdda31e2-c1bc-4c05-ace8-f07f0f6942aa tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:08.150498 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fdda31e2-c1bc-4c05-ace8-f07f0f6942aa tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:08.150977 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fdda31e2-c1bc-4c05-ace8-f07f0f6942aa tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:08.151774 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fdda31e2-c1bc-4c05-ace8-f07f0f6942aa tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:08.152202 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fdda31e2-c1bc-4c05-ace8-f07f0f6942aa tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:08.297652 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-fdda31e2-c1bc-4c05-ace8-f07f0f6942aa tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:08.305670 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-fdda31e2-c1bc-4c05-ace8-f07f0f6942aa tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1502 microversion: 2.1 time: 0.166463 Dec 23 11:59:08.306444 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 54/95] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:08 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:08.699892 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e8286def-eb15-4740-affa-278ab3832a63 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:08.701612 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e8286def-eb15-4740-affa-278ab3832a63 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:08.711021 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e8286def-eb15-4740-affa-278ab3832a63 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:08.712962 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e8286def-eb15-4740-affa-278ab3832a63 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:08.715304 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e8286def-eb15-4740-affa-278ab3832a63 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:08.716775 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e8286def-eb15-4740-affa-278ab3832a63 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:08.843202 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b302b508-94fd-4c5a-a6bd-d872dae3660b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:08.844243 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b302b508-94fd-4c5a-a6bd-d872dae3660b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:08.851019 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b302b508-94fd-4c5a-a6bd-d872dae3660b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:08.851662 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b302b508-94fd-4c5a-a6bd-d872dae3660b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:08.852612 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b302b508-94fd-4c5a-a6bd-d872dae3660b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:08.853331 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b302b508-94fd-4c5a-a6bd-d872dae3660b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:08.952511 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e8286def-eb15-4740-affa-278ab3832a63 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:08.959919 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e8286def-eb15-4740-affa-278ab3832a63 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1322 microversion: 2.1 time: 0.265025 Dec 23 11:59:08.961168 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 42/96] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:08 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:09.036815 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b302b508-94fd-4c5a-a6bd-d872dae3660b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:09.047525 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b302b508-94fd-4c5a-a6bd-d872dae3660b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:09.049720 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b302b508-94fd-4c5a-a6bd-d872dae3660b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:09.051772 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b302b508-94fd-4c5a-a6bd-d872dae3660b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1408 microversion: 2.20 time: 0.214275 Dec 23 11:59:09.052606 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 55/97] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:08 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 11:59:09.744949 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-ec84025c-015a-43a8-8d5c-bbc4b2801525 req-6214bd07-3f9a-4455-876d-30ebb3ab81f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f88906-0a5f-47a4-bf35-55db395a0e97", "name": "network-vif-plugged", "status": "completed", "tag": "b32d0851-1880-4e36-81d6-464702876f58"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:09.746915 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:59:09.746915 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 11:59:09.770705 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-ec84025c-015a-43a8-8d5c-bbc4b2801525 req-6214bd07-3f9a-4455-876d-30ebb3ab81f4 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:09.771599 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-ec84025c-015a-43a8-8d5c-bbc4b2801525 req-6214bd07-3f9a-4455-876d-30ebb3ab81f4 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:09.797729 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-ec84025c-015a-43a8-8d5c-bbc4b2801525 req-6214bd07-3f9a-4455-876d-30ebb3ab81f4 service nova] Creating event network-vif-plugged:b32d0851-1880-4e36-81d6-464702876f58 for instance 15f88906-0a5f-47a4-bf35-55db395a0e97 on hv-cinder-82282 Dec 23 11:59:09.809344 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-ec84025c-015a-43a8-8d5c-bbc4b2801525 req-6214bd07-3f9a-4455-876d-30ebb3ab81f4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068224 Dec 23 11:59:09.811051 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 43/98] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 11:59:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:59:09.857768 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8773eb3b-5c6e-4882-825f-e76a652a2873 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f6d99cf-c3f7-49c0-8a8a-0cb1da4dee77"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:09.859008 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-8773eb3b-5c6e-4882-825f-e76a652a2873 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:09.889487 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8773eb3b-5c6e-4882-825f-e76a652a2873 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:09.890853 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8773eb3b-5c6e-4882-825f-e76a652a2873 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:09.893476 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8773eb3b-5c6e-4882-825f-e76a652a2873 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:09.894141 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8773eb3b-5c6e-4882-825f-e76a652a2873 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:09.979702 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8e3da233-80ba-467e-b4c8-e0b5a59cad08 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:09.979702 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8e3da233-80ba-467e-b4c8-e0b5a59cad08 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:09.990317 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8e3da233-80ba-467e-b4c8-e0b5a59cad08 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:09.990803 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8e3da233-80ba-467e-b4c8-e0b5a59cad08 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:09.991581 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8e3da233-80ba-467e-b4c8-e0b5a59cad08 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:09.994594 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8e3da233-80ba-467e-b4c8-e0b5a59cad08 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:10.306057 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8e3da233-80ba-467e-b4c8-e0b5a59cad08 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:10.314146 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8e3da233-80ba-467e-b4c8-e0b5a59cad08 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1322 microversion: 2.1 time: 0.340234 Dec 23 11:59:10.316500 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 44/99] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:09 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:10.324641 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b71a74f2-78f5-46b8-859a-3ae0b551b13b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:10.327645 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b71a74f2-78f5-46b8-859a-3ae0b551b13b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:10.335525 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b71a74f2-78f5-46b8-859a-3ae0b551b13b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:10.336384 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b71a74f2-78f5-46b8-859a-3ae0b551b13b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:10.337185 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b71a74f2-78f5-46b8-859a-3ae0b551b13b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:10.337624 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b71a74f2-78f5-46b8-859a-3ae0b551b13b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:10.532474 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-8773eb3b-5c6e-4882-825f-e76a652a2873 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "POST /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.683134 Dec 23 11:59:10.538480 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 56/100] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Dec 23 11:59:09 2021] POST /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:59:10.582102 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-b71a74f2-78f5-46b8-859a-3ae0b551b13b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:10.594832 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-b71a74f2-78f5-46b8-859a-3ae0b551b13b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:10.600939 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-b71a74f2-78f5-46b8-859a-3ae0b551b13b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:10.602566 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b71a74f2-78f5-46b8-859a-3ae0b551b13b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1408 microversion: 2.20 time: 0.281584 Dec 23 11:59:10.605253 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 45/101] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:10 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1408 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:59:11.339106 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-94cafae8-265a-4434-a67f-6ac44102dee6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:11.340487 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-94cafae8-265a-4434-a67f-6ac44102dee6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:11.357044 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-94cafae8-265a-4434-a67f-6ac44102dee6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:11.357513 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-94cafae8-265a-4434-a67f-6ac44102dee6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:11.358333 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-94cafae8-265a-4434-a67f-6ac44102dee6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:11.358795 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-94cafae8-265a-4434-a67f-6ac44102dee6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:11.551193 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-94cafae8-265a-4434-a67f-6ac44102dee6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:11.563739 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-94cafae8-265a-4434-a67f-6ac44102dee6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1322 microversion: 2.1 time: 0.228627 Dec 23 11:59:11.565503 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 57/102] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:11 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:11.623266 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-be4e59ce-c149-4196-9078-cd31bd5bb4ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:11.623865 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-be4e59ce-c149-4196-9078-cd31bd5bb4ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:11.630156 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-be4e59ce-c149-4196-9078-cd31bd5bb4ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:11.630868 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-be4e59ce-c149-4196-9078-cd31bd5bb4ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:11.631608 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-be4e59ce-c149-4196-9078-cd31bd5bb4ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:11.632275 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-be4e59ce-c149-4196-9078-cd31bd5bb4ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:11.902541 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-be4e59ce-c149-4196-9078-cd31bd5bb4ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:11.914544 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-be4e59ce-c149-4196-9078-cd31bd5bb4ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:11.918073 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-be4e59ce-c149-4196-9078-cd31bd5bb4ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:11.924213 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-be4e59ce-c149-4196-9078-cd31bd5bb4ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1408 microversion: 2.20 time: 0.303853 Dec 23 11:59:11.925985 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 46/103] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:11 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1408 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:59:12.581048 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-1e31bcaf-23a8-48e7-babc-7dce25a7bd83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:12.581655 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-1e31bcaf-23a8-48e7-babc-7dce25a7bd83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:12.588195 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1e31bcaf-23a8-48e7-babc-7dce25a7bd83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:12.588781 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1e31bcaf-23a8-48e7-babc-7dce25a7bd83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:12.590149 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1e31bcaf-23a8-48e7-babc-7dce25a7bd83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:12.591127 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1e31bcaf-23a8-48e7-babc-7dce25a7bd83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:12.766211 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-1e31bcaf-23a8-48e7-babc-7dce25a7bd83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:12.775548 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-1e31bcaf-23a8-48e7-babc-7dce25a7bd83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1322 microversion: 2.1 time: 0.197807 Dec 23 11:59:12.779615 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 58/104] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:12 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:12.947287 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2969375b-d01c-4a76-a71e-b1305f270998 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:12.948158 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2969375b-d01c-4a76-a71e-b1305f270998 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:12.957500 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2969375b-d01c-4a76-a71e-b1305f270998 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:12.958709 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2969375b-d01c-4a76-a71e-b1305f270998 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:12.960059 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2969375b-d01c-4a76-a71e-b1305f270998 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:12.960696 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2969375b-d01c-4a76-a71e-b1305f270998 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:13.156064 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2969375b-d01c-4a76-a71e-b1305f270998 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:13.188651 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2969375b-d01c-4a76-a71e-b1305f270998 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:13.190477 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2969375b-d01c-4a76-a71e-b1305f270998 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:13.194852 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2969375b-d01c-4a76-a71e-b1305f270998 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1408 microversion: 2.20 time: 0.251968 Dec 23 11:59:13.211822 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 47/105] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:12 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:59:13.409252 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-ff6b4f85-a981-4e1c-a1af-2e01a6273444 req-385e1b73-6844-4a64-be55-527c6821021c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c78f6c-0393-44fa-8edd-0fe5cc257d7f", "name": "network-vif-plugged", "status": "completed", "tag": "4c211a14-71cd-421b-8af4-29651931f338"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:13.411084 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:59:13.411084 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 11:59:13.422406 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-ff6b4f85-a981-4e1c-a1af-2e01a6273444 req-385e1b73-6844-4a64-be55-527c6821021c service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:13.422953 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-ff6b4f85-a981-4e1c-a1af-2e01a6273444 req-385e1b73-6844-4a64-be55-527c6821021c service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:13.435940 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-ff6b4f85-a981-4e1c-a1af-2e01a6273444 req-385e1b73-6844-4a64-be55-527c6821021c service nova] Creating event network-vif-plugged:4c211a14-71cd-421b-8af4-29651931f338 for instance f1c78f6c-0393-44fa-8edd-0fe5cc257d7f on hv-cinder-82282 Dec 23 11:59:13.441361 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-ff6b4f85-a981-4e1c-a1af-2e01a6273444 req-385e1b73-6844-4a64-be55-527c6821021c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036855 Dec 23 11:59:13.442284 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 59/106] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 11:59:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:59:13.793452 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-68f58b40-2e08-4a31-8178-f324e728f966 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:13.794482 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-68f58b40-2e08-4a31-8178-f324e728f966 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:13.803872 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-68f58b40-2e08-4a31-8178-f324e728f966 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:13.805571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-68f58b40-2e08-4a31-8178-f324e728f966 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:13.807406 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-68f58b40-2e08-4a31-8178-f324e728f966 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:13.812836 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-68f58b40-2e08-4a31-8178-f324e728f966 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:14.059745 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-68f58b40-2e08-4a31-8178-f324e728f966 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:14.068399 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-68f58b40-2e08-4a31-8178-f324e728f966 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1322 microversion: 2.1 time: 0.278994 Dec 23 11:59:14.069601 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 48/107] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:13 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:14.214371 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-15d6ca22-5bb1-4c1a-b8fb-4dfe16db4606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:14.215423 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-15d6ca22-5bb1-4c1a-b8fb-4dfe16db4606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:14.223695 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-15d6ca22-5bb1-4c1a-b8fb-4dfe16db4606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:14.224355 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-15d6ca22-5bb1-4c1a-b8fb-4dfe16db4606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:14.225735 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-15d6ca22-5bb1-4c1a-b8fb-4dfe16db4606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:14.226235 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-15d6ca22-5bb1-4c1a-b8fb-4dfe16db4606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:14.428262 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-15d6ca22-5bb1-4c1a-b8fb-4dfe16db4606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:14.438472 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-15d6ca22-5bb1-4c1a-b8fb-4dfe16db4606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:14.440168 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-15d6ca22-5bb1-4c1a-b8fb-4dfe16db4606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:14.441756 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-15d6ca22-5bb1-4c1a-b8fb-4dfe16db4606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1408 microversion: 2.20 time: 0.232260 Dec 23 11:59:14.442504 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 60/108] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:14 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:59:15.085283 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9e5281b5-4229-468d-888e-3c4bb2042fa3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:15.085924 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9e5281b5-4229-468d-888e-3c4bb2042fa3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:15.094725 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9e5281b5-4229-468d-888e-3c4bb2042fa3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:15.095177 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9e5281b5-4229-468d-888e-3c4bb2042fa3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:15.095966 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9e5281b5-4229-468d-888e-3c4bb2042fa3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:15.096440 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9e5281b5-4229-468d-888e-3c4bb2042fa3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:15.431624 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9e5281b5-4229-468d-888e-3c4bb2042fa3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:15.440208 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9e5281b5-4229-468d-888e-3c4bb2042fa3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1322 microversion: 2.1 time: 0.358765 Dec 23 11:59:15.440842 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 49/109] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:15 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:15.462257 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e1769eef-e6d5-4111-afe5-91bfb616c011 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:15.463471 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e1769eef-e6d5-4111-afe5-91bfb616c011 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:15.473227 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e1769eef-e6d5-4111-afe5-91bfb616c011 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:15.473815 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e1769eef-e6d5-4111-afe5-91bfb616c011 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:15.474988 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e1769eef-e6d5-4111-afe5-91bfb616c011 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:15.475489 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e1769eef-e6d5-4111-afe5-91bfb616c011 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:15.509050 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-43841bb2-c2fe-4a32-9b51-676c23dee9b4 req-f7acf646-3465-4b85-bdce-70c3ff90b559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc998144-5288-467f-82de-9c1983559e40", "name": "network-vif-plugged", "status": "completed", "tag": "bbf34ca1-ab1a-4521-9402-ff6d335fe55a"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:15.512265 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:59:15.512265 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 11:59:15.524436 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-43841bb2-c2fe-4a32-9b51-676c23dee9b4 req-f7acf646-3465-4b85-bdce-70c3ff90b559 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:15.525101 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-43841bb2-c2fe-4a32-9b51-676c23dee9b4 req-f7acf646-3465-4b85-bdce-70c3ff90b559 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:15.538850 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-43841bb2-c2fe-4a32-9b51-676c23dee9b4 req-f7acf646-3465-4b85-bdce-70c3ff90b559 service nova] Creating event network-vif-plugged:bbf34ca1-ab1a-4521-9402-ff6d335fe55a for instance fc998144-5288-467f-82de-9c1983559e40 on hv-cinder-82282 Dec 23 11:59:15.546488 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-43841bb2-c2fe-4a32-9b51-676c23dee9b4 req-f7acf646-3465-4b85-bdce-70c3ff90b559 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043615 Dec 23 11:59:15.548276 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 50/110] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 11:59:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 11:59:15.617790 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e1769eef-e6d5-4111-afe5-91bfb616c011 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:15.627779 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e1769eef-e6d5-4111-afe5-91bfb616c011 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:15.629930 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e1769eef-e6d5-4111-afe5-91bfb616c011 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:15.631463 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e1769eef-e6d5-4111-afe5-91bfb616c011 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1408 microversion: 2.20 time: 0.174775 Dec 23 11:59:15.632352 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 61/111] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:15 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:59:16.457895 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-156bc79d-5ae1-40bc-89a9-e2c119ab50e2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:16.458694 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-156bc79d-5ae1-40bc-89a9-e2c119ab50e2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:16.464785 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-156bc79d-5ae1-40bc-89a9-e2c119ab50e2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:16.465473 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-156bc79d-5ae1-40bc-89a9-e2c119ab50e2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:16.466499 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-156bc79d-5ae1-40bc-89a9-e2c119ab50e2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:16.466955 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-156bc79d-5ae1-40bc-89a9-e2c119ab50e2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:16.649233 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a39ead90-28da-42a8-8123-d26cf196162a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:16.649846 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a39ead90-28da-42a8-8123-d26cf196162a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:16.656388 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a39ead90-28da-42a8-8123-d26cf196162a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:16.656844 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a39ead90-28da-42a8-8123-d26cf196162a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:16.657623 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a39ead90-28da-42a8-8123-d26cf196162a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:16.658056 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a39ead90-28da-42a8-8123-d26cf196162a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:16.688194 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-156bc79d-5ae1-40bc-89a9-e2c119ab50e2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:16.695581 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-156bc79d-5ae1-40bc-89a9-e2c119ab50e2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1322 microversion: 2.1 time: 0.241604 Dec 23 11:59:16.696150 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 51/112] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:16 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:16.855294 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a39ead90-28da-42a8-8123-d26cf196162a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:16.864942 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a39ead90-28da-42a8-8123-d26cf196162a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:16.866578 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a39ead90-28da-42a8-8123-d26cf196162a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:16.867716 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a39ead90-28da-42a8-8123-d26cf196162a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1408 microversion: 2.20 time: 0.222301 Dec 23 11:59:16.868282 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 62/113] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:16 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 11:59:17.712336 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3097f61e-3261-44b9-8cef-bffaf25b9e17 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:17.712939 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3097f61e-3261-44b9-8cef-bffaf25b9e17 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:17.719099 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3097f61e-3261-44b9-8cef-bffaf25b9e17 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:17.719550 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3097f61e-3261-44b9-8cef-bffaf25b9e17 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:17.720321 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3097f61e-3261-44b9-8cef-bffaf25b9e17 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:17.720756 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3097f61e-3261-44b9-8cef-bffaf25b9e17 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:17.864335 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3097f61e-3261-44b9-8cef-bffaf25b9e17 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:17.872377 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3097f61e-3261-44b9-8cef-bffaf25b9e17 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1322 microversion: 2.1 time: 0.163628 Dec 23 11:59:17.872949 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 52/114] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:17 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:17.884999 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c78f466d-3ccd-4016-a469-772b94d58344 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:17.885591 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c78f466d-3ccd-4016-a469-772b94d58344 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:17.891956 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c78f466d-3ccd-4016-a469-772b94d58344 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:17.892409 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c78f466d-3ccd-4016-a469-772b94d58344 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:17.893179 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c78f466d-3ccd-4016-a469-772b94d58344 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:17.893614 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c78f466d-3ccd-4016-a469-772b94d58344 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:18.024198 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c78f466d-3ccd-4016-a469-772b94d58344 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:18.032357 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c78f466d-3ccd-4016-a469-772b94d58344 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:18.033879 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c78f466d-3ccd-4016-a469-772b94d58344 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:18.035022 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c78f466d-3ccd-4016-a469-772b94d58344 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1408 microversion: 2.20 time: 0.153751 Dec 23 11:59:18.035944 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 63/115] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:17 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:59:18.890740 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-927bfe4d-dc9e-4bc2-9cfc-6f28881d1128 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:18.891310 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-927bfe4d-dc9e-4bc2-9cfc-6f28881d1128 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:18.897955 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-927bfe4d-dc9e-4bc2-9cfc-6f28881d1128 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:18.898757 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-927bfe4d-dc9e-4bc2-9cfc-6f28881d1128 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:18.899747 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-927bfe4d-dc9e-4bc2-9cfc-6f28881d1128 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:18.900260 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-927bfe4d-dc9e-4bc2-9cfc-6f28881d1128 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:19.054160 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ecc32560-624b-4132-ad29-b152095bc2d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:19.054819 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ecc32560-624b-4132-ad29-b152095bc2d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:19.078924 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ecc32560-624b-4132-ad29-b152095bc2d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:19.079451 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ecc32560-624b-4132-ad29-b152095bc2d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:19.080266 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ecc32560-624b-4132-ad29-b152095bc2d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:19.080704 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ecc32560-624b-4132-ad29-b152095bc2d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:19.093836 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-927bfe4d-dc9e-4bc2-9cfc-6f28881d1128 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:19.104588 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-927bfe4d-dc9e-4bc2-9cfc-6f28881d1128 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1322 microversion: 2.1 time: 0.217888 Dec 23 11:59:19.105228 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 53/116] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:18 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:19.254499 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ecc32560-624b-4132-ad29-b152095bc2d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:19.265585 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ecc32560-624b-4132-ad29-b152095bc2d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:19.268103 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ecc32560-624b-4132-ad29-b152095bc2d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:19.269759 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ecc32560-624b-4132-ad29-b152095bc2d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1408 microversion: 2.20 time: 0.220971 Dec 23 11:59:19.270276 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 64/117] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:19 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:59:20.122958 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e435a8ca-fc04-4c5e-aa75-77eae712fece tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:20.123706 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e435a8ca-fc04-4c5e-aa75-77eae712fece tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:20.130539 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e435a8ca-fc04-4c5e-aa75-77eae712fece tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:20.131091 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e435a8ca-fc04-4c5e-aa75-77eae712fece tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:20.131872 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e435a8ca-fc04-4c5e-aa75-77eae712fece tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:20.132308 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e435a8ca-fc04-4c5e-aa75-77eae712fece tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:20.282454 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e435a8ca-fc04-4c5e-aa75-77eae712fece tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:20.284268 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e435a8ca-fc04-4c5e-aa75-77eae712fece tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1516 microversion: 2.1 time: 0.165505 Dec 23 11:59:20.285453 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 54/118] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:20 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:20.301394 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-56dc444f-d3ae-4711-9ea4-bceceb5a0820 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:20.302106 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-56dc444f-d3ae-4711-9ea4-bceceb5a0820 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:20.309036 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-56dc444f-d3ae-4711-9ea4-bceceb5a0820 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:20.309742 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-56dc444f-d3ae-4711-9ea4-bceceb5a0820 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:20.310853 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-56dc444f-d3ae-4711-9ea4-bceceb5a0820 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:20.311350 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-56dc444f-d3ae-4711-9ea4-bceceb5a0820 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:20.311449 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b8ab6afb-e590-4d67-9850-b3270cea0aba tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:20.312352 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b8ab6afb-e590-4d67-9850-b3270cea0aba tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:20.318367 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b8ab6afb-e590-4d67-9850-b3270cea0aba tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:20.318938 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b8ab6afb-e590-4d67-9850-b3270cea0aba tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:20.319914 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b8ab6afb-e590-4d67-9850-b3270cea0aba tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:20.321182 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b8ab6afb-e590-4d67-9850-b3270cea0aba tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:20.398564 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-b8ab6afb-e590-4d67-9850-b3270cea0aba tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lazy-loading 'flavor' on Instance uuid f1c78f6c-0393-44fa-8edd-0fe5cc257d7f {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 11:59:20.473584 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-56dc444f-d3ae-4711-9ea4-bceceb5a0820 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:20.482568 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-56dc444f-d3ae-4711-9ea4-bceceb5a0820 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:20.485457 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-56dc444f-d3ae-4711-9ea4-bceceb5a0820 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:20.487395 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-56dc444f-d3ae-4711-9ea4-bceceb5a0820 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1408 microversion: 2.20 time: 0.190449 Dec 23 11:59:20.499471 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 65/119] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:20 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 11:59:20.554371 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b8ab6afb-e590-4d67-9850-b3270cea0aba tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "POST /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f/action" status: 200 len: 32 microversion: 2.1 time: 0.246751 Dec 23 11:59:20.555220 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 55/120] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 11:59:20 2021] POST /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f/action => generated 32 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 11:59:20.564303 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-884f3948-42a9-40e8-9fa4-3b46c38a629e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:20.564908 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-884f3948-42a9-40e8-9fa4-3b46c38a629e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:20.578286 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-884f3948-42a9-40e8-9fa4-3b46c38a629e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:20.578957 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-884f3948-42a9-40e8-9fa4-3b46c38a629e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:20.579837 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-884f3948-42a9-40e8-9fa4-3b46c38a629e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:20.580270 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-884f3948-42a9-40e8-9fa4-3b46c38a629e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:20.742891 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-884f3948-42a9-40e8-9fa4-3b46c38a629e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:20.750619 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-884f3948-42a9-40e8-9fa4-3b46c38a629e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.190086 Dec 23 11:59:20.751392 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 66/121] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:20 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:21.508632 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4c6ab8b6-9f48-4d62-bb6a-cd67e0fbeb85 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:21.509328 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4c6ab8b6-9f48-4d62-bb6a-cd67e0fbeb85 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:21.515918 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4c6ab8b6-9f48-4d62-bb6a-cd67e0fbeb85 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:21.516396 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4c6ab8b6-9f48-4d62-bb6a-cd67e0fbeb85 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:21.517159 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4c6ab8b6-9f48-4d62-bb6a-cd67e0fbeb85 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:21.517587 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4c6ab8b6-9f48-4d62-bb6a-cd67e0fbeb85 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:21.686863 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4c6ab8b6-9f48-4d62-bb6a-cd67e0fbeb85 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:21.695346 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4c6ab8b6-9f48-4d62-bb6a-cd67e0fbeb85 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:21.696834 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4c6ab8b6-9f48-4d62-bb6a-cd67e0fbeb85 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:21.697954 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4c6ab8b6-9f48-4d62-bb6a-cd67e0fbeb85 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1408 microversion: 2.20 time: 0.193597 Dec 23 11:59:21.698851 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 56/122] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:21 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:59:21.768226 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-79d88952-7a93-4756-b1c0-da1b8ac9a312 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:21.769045 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-79d88952-7a93-4756-b1c0-da1b8ac9a312 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:21.778254 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-79d88952-7a93-4756-b1c0-da1b8ac9a312 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:21.778758 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-79d88952-7a93-4756-b1c0-da1b8ac9a312 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:21.779539 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-79d88952-7a93-4756-b1c0-da1b8ac9a312 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:21.779967 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-79d88952-7a93-4756-b1c0-da1b8ac9a312 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:21.920245 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-79d88952-7a93-4756-b1c0-da1b8ac9a312 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:21.928517 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-79d88952-7a93-4756-b1c0-da1b8ac9a312 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.163933 Dec 23 11:59:21.934119 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 67/123] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:21 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:59:22.715780 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9ba85468-d404-4a57-9d48-11f098c485a9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:22.717142 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9ba85468-d404-4a57-9d48-11f098c485a9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:22.723665 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9ba85468-d404-4a57-9d48-11f098c485a9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:22.724477 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9ba85468-d404-4a57-9d48-11f098c485a9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:22.725320 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9ba85468-d404-4a57-9d48-11f098c485a9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:22.725816 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9ba85468-d404-4a57-9d48-11f098c485a9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:22.872565 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9ba85468-d404-4a57-9d48-11f098c485a9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:22.879628 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9ba85468-d404-4a57-9d48-11f098c485a9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:22.881112 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9ba85468-d404-4a57-9d48-11f098c485a9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:22.882417 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9ba85468-d404-4a57-9d48-11f098c485a9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1600 microversion: 2.20 time: 0.170457 Dec 23 11:59:22.883310 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 57/124] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 11:59:22 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 11:59:22.901853 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4f571c33-0060-4ef4-a205-2ade63bed033 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:22.902428 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4f571c33-0060-4ef4-a205-2ade63bed033 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:22.911206 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4f571c33-0060-4ef4-a205-2ade63bed033 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:22.912248 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4f571c33-0060-4ef4-a205-2ade63bed033 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:22.914165 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4f571c33-0060-4ef4-a205-2ade63bed033 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:22.915104 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4f571c33-0060-4ef4-a205-2ade63bed033 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:22.945564 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d6107e89-e2e8-4716-8cbb-eb810bd20ac2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:22.946580 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d6107e89-e2e8-4716-8cbb-eb810bd20ac2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:22.953013 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d6107e89-e2e8-4716-8cbb-eb810bd20ac2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:22.953576 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d6107e89-e2e8-4716-8cbb-eb810bd20ac2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:22.954613 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d6107e89-e2e8-4716-8cbb-eb810bd20ac2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:22.955274 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d6107e89-e2e8-4716-8cbb-eb810bd20ac2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:23.009363 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4f571c33-0060-4ef4-a205-2ade63bed033 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.112148 Dec 23 11:59:23.010009 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 68/125] 10.222.0.65 () {60 vars in 1315 bytes} [Thu Dec 23 11:59:22 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 11:59:23.132902 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-d6107e89-e2e8-4716-8cbb-eb810bd20ac2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:23.142754 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d6107e89-e2e8-4716-8cbb-eb810bd20ac2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.200208 Dec 23 11:59:23.143774 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 58/126] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:22 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:59:24.161890 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-bff49914-8715-4347-b7b6-f5513572b8b9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:24.171790 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-bff49914-8715-4347-b7b6-f5513572b8b9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:24.179227 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bff49914-8715-4347-b7b6-f5513572b8b9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:24.180303 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bff49914-8715-4347-b7b6-f5513572b8b9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:24.181299 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bff49914-8715-4347-b7b6-f5513572b8b9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:24.182018 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bff49914-8715-4347-b7b6-f5513572b8b9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:24.346357 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-bff49914-8715-4347-b7b6-f5513572b8b9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:24.354233 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-bff49914-8715-4347-b7b6-f5513572b8b9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.197644 Dec 23 11:59:24.355371 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 69/127] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:24 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:24.727556 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b5a22a99-cd2a-4f65-8d6c-9828585569b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:24.729495 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b5a22a99-cd2a-4f65-8d6c-9828585569b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:24.736189 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b5a22a99-cd2a-4f65-8d6c-9828585569b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:24.737016 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b5a22a99-cd2a-4f65-8d6c-9828585569b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:24.738194 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b5a22a99-cd2a-4f65-8d6c-9828585569b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:24.740116 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b5a22a99-cd2a-4f65-8d6c-9828585569b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:25.121896 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-b7604f0b-5252-4c07-a937-5536dd700942 req-aa93c870-9272-4787-aa7e-c0504043ef75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc998144-5288-467f-82de-9c1983559e40", "tag": "bbf34ca1-ab1a-4521-9402-ff6d335fe55a"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:25.123505 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:59:25.123505 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 11:59:25.130465 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-b7604f0b-5252-4c07-a937-5536dd700942 req-aa93c870-9272-4787-aa7e-c0504043ef75 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:25.130943 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-b7604f0b-5252-4c07-a937-5536dd700942 req-aa93c870-9272-4787-aa7e-c0504043ef75 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:25.142156 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-b7604f0b-5252-4c07-a937-5536dd700942 req-aa93c870-9272-4787-aa7e-c0504043ef75 service nova] Creating event network-changed:bbf34ca1-ab1a-4521-9402-ff6d335fe55a for instance fc998144-5288-467f-82de-9c1983559e40 on hv-cinder-82282 Dec 23 11:59:25.147958 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-b7604f0b-5252-4c07-a937-5536dd700942 req-aa93c870-9272-4787-aa7e-c0504043ef75 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249096 Dec 23 11:59:25.148541 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 70/128] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 11:59:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 11:59:25.373283 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2275409b-0815-43fc-be43-0172cd56d477 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:25.374899 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2275409b-0815-43fc-be43-0172cd56d477 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:25.382445 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2275409b-0815-43fc-be43-0172cd56d477 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:25.382866 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2275409b-0815-43fc-be43-0172cd56d477 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:25.383680 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2275409b-0815-43fc-be43-0172cd56d477 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:25.384109 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2275409b-0815-43fc-be43-0172cd56d477 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:25.527900 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-2275409b-0815-43fc-be43-0172cd56d477 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:25.537380 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2275409b-0815-43fc-be43-0172cd56d477 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.168547 Dec 23 11:59:25.538302 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 71/129] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:25 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:25.972976 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b5a22a99-cd2a-4f65-8d6c-9828585569b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 14 microversion: 2.20 time: 1.249102 Dec 23 11:59:25.974542 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 59/130] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:24 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 14 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:26.553383 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-87c116fa-7f24-4a10-a195-8a6ad766c205 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:26.554146 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-87c116fa-7f24-4a10-a195-8a6ad766c205 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:26.562209 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-87c116fa-7f24-4a10-a195-8a6ad766c205 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:26.562816 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-87c116fa-7f24-4a10-a195-8a6ad766c205 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:26.563706 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-87c116fa-7f24-4a10-a195-8a6ad766c205 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:26.564238 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-87c116fa-7f24-4a10-a195-8a6ad766c205 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:26.711166 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-728ccee0-6c73-4cc5-a9c7-dbbc9c2effca tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:26.711924 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-728ccee0-6c73-4cc5-a9c7-dbbc9c2effca tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:26.720592 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-728ccee0-6c73-4cc5-a9c7-dbbc9c2effca tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:26.721229 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-728ccee0-6c73-4cc5-a9c7-dbbc9c2effca tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:26.722390 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-728ccee0-6c73-4cc5-a9c7-dbbc9c2effca tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:26.723021 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-728ccee0-6c73-4cc5-a9c7-dbbc9c2effca tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:26.771035 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-87c116fa-7f24-4a10-a195-8a6ad766c205 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:26.780979 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-87c116fa-7f24-4a10-a195-8a6ad766c205 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.231064 Dec 23 11:59:26.791425 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 72/131] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:26 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:26.794258 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-728ccee0-6c73-4cc5-a9c7-dbbc9c2effca tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Going to try to terminate instance {{(pid=116354) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 11:59:26.884355 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-728ccee0-6c73-4cc5-a9c7-dbbc9c2effca tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "DELETE /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 204 len: 0 microversion: 2.1 time: 0.178349 Dec 23 11:59:26.885293 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 60/132] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 11:59:26 2021] DELETE /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 23 11:59:26.894174 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-6c4e5d75-5046-498c-b23b-51331d17f963 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:26.894870 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-6c4e5d75-5046-498c-b23b-51331d17f963 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:26.901537 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6c4e5d75-5046-498c-b23b-51331d17f963 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:26.902059 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6c4e5d75-5046-498c-b23b-51331d17f963 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:26.903070 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6c4e5d75-5046-498c-b23b-51331d17f963 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:26.903573 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6c4e5d75-5046-498c-b23b-51331d17f963 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:26.986120 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5bdeddaa-d4fc-4c5d-b155-0a358be8679c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:26.990730 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5bdeddaa-d4fc-4c5d-b155-0a358be8679c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:26.998615 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5bdeddaa-d4fc-4c5d-b155-0a358be8679c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:26.999064 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5bdeddaa-d4fc-4c5d-b155-0a358be8679c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:26.999857 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5bdeddaa-d4fc-4c5d-b155-0a358be8679c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:27.000546 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5bdeddaa-d4fc-4c5d-b155-0a358be8679c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:27.055324 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-6c4e5d75-5046-498c-b23b-51331d17f963 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:27.063516 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-6c4e5d75-5046-498c-b23b-51331d17f963 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1554 microversion: 2.1 time: 0.174061 Dec 23 11:59:27.066942 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 73/133] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:26 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:27.173638 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5bdeddaa-d4fc-4c5d-b155-0a358be8679c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 14 microversion: 2.20 time: 0.191709 Dec 23 11:59:27.174331 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 61/134] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:26 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:27.799855 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-29cda1b0-8703-49f7-a40c-cc3d7eaab4b1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:27.800403 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-29cda1b0-8703-49f7-a40c-cc3d7eaab4b1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:27.807495 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-29cda1b0-8703-49f7-a40c-cc3d7eaab4b1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:27.808207 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-29cda1b0-8703-49f7-a40c-cc3d7eaab4b1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:27.809042 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-29cda1b0-8703-49f7-a40c-cc3d7eaab4b1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:27.809481 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-29cda1b0-8703-49f7-a40c-cc3d7eaab4b1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:27.997590 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-29cda1b0-8703-49f7-a40c-cc3d7eaab4b1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:28.006314 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-29cda1b0-8703-49f7-a40c-cc3d7eaab4b1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.210038 Dec 23 11:59:28.007167 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 74/135] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:27 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:28.084293 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-07912a41-f879-44d4-afef-96431ef8a38f tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:28.085008 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-07912a41-f879-44d4-afef-96431ef8a38f tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:28.092021 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-07912a41-f879-44d4-afef-96431ef8a38f tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:28.092630 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-07912a41-f879-44d4-afef-96431ef8a38f tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:28.093411 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-07912a41-f879-44d4-afef-96431ef8a38f tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:28.093841 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-07912a41-f879-44d4-afef-96431ef8a38f tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:28.185392 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5edb8394-00c8-47d5-8921-2b499832a54f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:28.186355 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5edb8394-00c8-47d5-8921-2b499832a54f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:28.193464 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5edb8394-00c8-47d5-8921-2b499832a54f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:28.194320 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5edb8394-00c8-47d5-8921-2b499832a54f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:28.195339 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5edb8394-00c8-47d5-8921-2b499832a54f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:28.195851 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5edb8394-00c8-47d5-8921-2b499832a54f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:28.240530 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-07912a41-f879-44d4-afef-96431ef8a38f tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:28.248746 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-07912a41-f879-44d4-afef-96431ef8a38f tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1554 microversion: 2.1 time: 0.170076 Dec 23 11:59:28.249324 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 62/136] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:28 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:28.328655 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5edb8394-00c8-47d5-8921-2b499832a54f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 14 microversion: 2.20 time: 0.147437 Dec 23 11:59:28.329225 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 75/137] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:28 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:59:29.023989 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-cb0a680c-5730-47f4-a45a-1670ada94d76 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:29.024621 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-cb0a680c-5730-47f4-a45a-1670ada94d76 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:29.032120 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cb0a680c-5730-47f4-a45a-1670ada94d76 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:29.032655 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cb0a680c-5730-47f4-a45a-1670ada94d76 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:29.033507 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cb0a680c-5730-47f4-a45a-1670ada94d76 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:29.034020 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cb0a680c-5730-47f4-a45a-1670ada94d76 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:29.174395 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-cb0a680c-5730-47f4-a45a-1670ada94d76 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:29.182901 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-cb0a680c-5730-47f4-a45a-1670ada94d76 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.162489 Dec 23 11:59:29.193093 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 63/138] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:29 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:29.243294 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-aaed3033-f866-4f52-8cf9-ff3e4f102923 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-471931968", "imageRef": "938a78c0-341e-4043-927a-9bfe8cf52508", "flavorRef": "452", "networks": [{"uuid": "c19c572b-1b5e-4a3c-96b3-4936188f29bd"}]}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:29.267507 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c3c1fe3a-df4f-4903-bbae-5b828bddd69e tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:29.268121 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c3c1fe3a-df4f-4903-bbae-5b828bddd69e tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:29.273903 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c3c1fe3a-df4f-4903-bbae-5b828bddd69e tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:29.274346 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c3c1fe3a-df4f-4903-bbae-5b828bddd69e tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:29.275311 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c3c1fe3a-df4f-4903-bbae-5b828bddd69e tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:29.275734 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c3c1fe3a-df4f-4903-bbae-5b828bddd69e tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:29.301442 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.network.neutron [None req-aaed3033-f866-4f52-8cf9-ff3e4f102923 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] validate_networks() for [('c19c572b-1b5e-4a3c-96b3-4936188f29bd', None, None, None, None, None)] {{(pid=116355) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 11:59:29.515488 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c3c1fe3a-df4f-4903-bbae-5b828bddd69e tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:29.524766 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c3c1fe3a-df4f-4903-bbae-5b828bddd69e tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1554 microversion: 2.1 time: 0.261096 Dec 23 11:59:29.525680 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 64/139] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:29 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1554 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:59:29.540436 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-87c5ec2e-2c81-480b-8e7f-dc61f0d4bcae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:29.541789 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-87c5ec2e-2c81-480b-8e7f-dc61f0d4bcae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:29.549865 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-87c5ec2e-2c81-480b-8e7f-dc61f0d4bcae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:29.550320 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-87c5ec2e-2c81-480b-8e7f-dc61f0d4bcae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:29.551167 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-87c5ec2e-2c81-480b-8e7f-dc61f0d4bcae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:29.551598 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-87c5ec2e-2c81-480b-8e7f-dc61f0d4bcae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:29.687138 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-87c5ec2e-2c81-480b-8e7f-dc61f0d4bcae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 14 microversion: 2.20 time: 0.150415 Dec 23 11:59:29.688035 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 65/140] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:29 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:29.931298 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-aaed3033-f866-4f52-8cf9-ff3e4f102923 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Flavor limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 11:59:29.933480 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-aaed3033-f866-4f52-8cf9-ff3e4f102923 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Image limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 11:59:29.933480 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-aaed3033-f866-4f52-8cf9-ff3e4f102923 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Flavor pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 11:59:29.933480 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-aaed3033-f866-4f52-8cf9-ff3e4f102923 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Image pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 11:59:29.933480 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-aaed3033-f866-4f52-8cf9-ff3e4f102923 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 11:59:29.966859 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aaed3033-f866-4f52-8cf9-ff3e4f102923 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:29.967388 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aaed3033-f866-4f52-8cf9-ff3e4f102923 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:29.968210 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aaed3033-f866-4f52-8cf9-ff3e4f102923 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:29.968798 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aaed3033-f866-4f52-8cf9-ff3e4f102923 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:29.987907 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-aaed3033-f866-4f52-8cf9-ff3e4f102923 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Getting quotas for project 7ca5ca45c6494bff9a1a66863948f839. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 11:59:29.991930 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-aaed3033-f866-4f52-8cf9-ff3e4f102923 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Getting quotas for user b9397ca2bd8a4195a2c54dbb1a97ddf0 and project 7ca5ca45c6494bff9a1a66863948f839. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 11:59:30.002692 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-aaed3033-f866-4f52-8cf9-ff3e4f102923 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Going to run 1 instances... {{(pid=116355) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 11:59:30.005193 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-aaed3033-f866-4f52-8cf9-ff3e4f102923 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='938a78c0-341e-4043-927a-9bfe8cf52508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 11:59:30.054906 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-aaed3033-f866-4f52-8cf9-ff3e4f102923 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815689 Dec 23 11:59:30.060604 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 76/141] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 11:59:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 23 11:59:30.067534 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5b317436-87e8-4010-8ab9-7d6036252709 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:30.069588 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5b317436-87e8-4010-8ab9-7d6036252709 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:30.127814 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-5b317436-87e8-4010-8ab9-7d6036252709 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:30.134974 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5b317436-87e8-4010-8ab9-7d6036252709 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1213 microversion: 2.1 time: 0.072580 Dec 23 11:59:30.135614 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 66/142] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:30 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:59:30.200364 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e6e12e88-1ae7-4f8a-b44c-64e8d12b7a11 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:30.200966 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e6e12e88-1ae7-4f8a-b44c-64e8d12b7a11 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:30.223972 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6e12e88-1ae7-4f8a-b44c-64e8d12b7a11 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:30.224400 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6e12e88-1ae7-4f8a-b44c-64e8d12b7a11 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:30.225195 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6e12e88-1ae7-4f8a-b44c-64e8d12b7a11 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:30.225653 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6e12e88-1ae7-4f8a-b44c-64e8d12b7a11 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:30.396186 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e6e12e88-1ae7-4f8a-b44c-64e8d12b7a11 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:30.404854 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e6e12e88-1ae7-4f8a-b44c-64e8d12b7a11 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.208216 Dec 23 11:59:30.405426 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 77/143] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:30 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:30.543307 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-14e7bbad-8b2b-4696-aa71-640447cb54e2 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:30.543925 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-14e7bbad-8b2b-4696-aa71-640447cb54e2 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:30.551655 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-14e7bbad-8b2b-4696-aa71-640447cb54e2 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:30.558056 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-14e7bbad-8b2b-4696-aa71-640447cb54e2 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:30.563892 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-14e7bbad-8b2b-4696-aa71-640447cb54e2 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:30.566564 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-14e7bbad-8b2b-4696-aa71-640447cb54e2 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:30.697169 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4dbb0934-1bf5-4ede-9d73-e0a8c1978b78 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:30.698135 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4dbb0934-1bf5-4ede-9d73-e0a8c1978b78 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:30.704635 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4dbb0934-1bf5-4ede-9d73-e0a8c1978b78 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:30.705247 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4dbb0934-1bf5-4ede-9d73-e0a8c1978b78 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:30.706190 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4dbb0934-1bf5-4ede-9d73-e0a8c1978b78 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:30.706782 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4dbb0934-1bf5-4ede-9d73-e0a8c1978b78 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:30.732541 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-14e7bbad-8b2b-4696-aa71-640447cb54e2 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:30.743378 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-14e7bbad-8b2b-4696-aa71-640447cb54e2 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1554 microversion: 2.1 time: 0.204267 Dec 23 11:59:30.744079 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 67/144] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:30 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1554 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:31.012827 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4dbb0934-1bf5-4ede-9d73-e0a8c1978b78 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 14 microversion: 2.20 time: 0.319000 Dec 23 11:59:31.015009 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 78/145] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:30 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 14 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:31.152600 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-01f3bdf2-9dfa-4c44-aaf5-59df1454225f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:31.153223 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-01f3bdf2-9dfa-4c44-aaf5-59df1454225f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:31.160272 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-01f3bdf2-9dfa-4c44-aaf5-59df1454225f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:31.161677 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-01f3bdf2-9dfa-4c44-aaf5-59df1454225f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:31.162452 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-01f3bdf2-9dfa-4c44-aaf5-59df1454225f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:31.162920 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-01f3bdf2-9dfa-4c44-aaf5-59df1454225f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:31.243952 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-01f3bdf2-9dfa-4c44-aaf5-59df1454225f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:31.251617 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-01f3bdf2-9dfa-4c44-aaf5-59df1454225f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1265 microversion: 2.1 time: 0.103174 Dec 23 11:59:31.252236 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 68/146] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:31 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:31.422185 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3c8dfd1f-24c9-4de3-9f93-27f99367d20c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:31.422978 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3c8dfd1f-24c9-4de3-9f93-27f99367d20c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:31.429589 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3c8dfd1f-24c9-4de3-9f93-27f99367d20c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:31.430036 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3c8dfd1f-24c9-4de3-9f93-27f99367d20c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:31.430837 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3c8dfd1f-24c9-4de3-9f93-27f99367d20c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:31.431273 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3c8dfd1f-24c9-4de3-9f93-27f99367d20c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:31.692023 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-add28b63-7e48-4a2d-862b-22ccd4e6f56c req-d943bddb-2d3b-4364-a4ed-8272888edc91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "518c84e9-aab7-44b1-b614-30ffee393824", "name": "network-vif-deleted", "tag": "22f1c7ad-1474-4ad8-9cfd-7bcc25d1951a"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:31.693933 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:59:31.693933 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 11:59:31.697062 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3c8dfd1f-24c9-4de3-9f93-27f99367d20c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:31.702976 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-add28b63-7e48-4a2d-862b-22ccd4e6f56c req-d943bddb-2d3b-4364-a4ed-8272888edc91 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:31.703420 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-add28b63-7e48-4a2d-862b-22ccd4e6f56c req-d943bddb-2d3b-4364-a4ed-8272888edc91 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:31.704655 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3c8dfd1f-24c9-4de3-9f93-27f99367d20c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.287004 Dec 23 11:59:31.705242 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 79/147] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:31 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:31.716154 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-add28b63-7e48-4a2d-862b-22ccd4e6f56c req-d943bddb-2d3b-4364-a4ed-8272888edc91 service nova] Creating event network-vif-deleted:22f1c7ad-1474-4ad8-9cfd-7bcc25d1951a for instance 518c84e9-aab7-44b1-b614-30ffee393824 on hv-cinder-82282 Dec 23 11:59:31.721588 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-add28b63-7e48-4a2d-862b-22ccd4e6f56c req-d943bddb-2d3b-4364-a4ed-8272888edc91 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033821 Dec 23 11:59:31.723045 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 69/148] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 11:59:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:59:31.762707 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-41b597ed-6ddf-4d4d-8561-26f797b16e15 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:31.763321 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-41b597ed-6ddf-4d4d-8561-26f797b16e15 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:31.769218 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-41b597ed-6ddf-4d4d-8561-26f797b16e15 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:31.769667 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-41b597ed-6ddf-4d4d-8561-26f797b16e15 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:31.770437 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-41b597ed-6ddf-4d4d-8561-26f797b16e15 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:31.770907 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-41b597ed-6ddf-4d4d-8561-26f797b16e15 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:31.833324 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-41b597ed-6ddf-4d4d-8561-26f797b16e15 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:31.841729 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-41b597ed-6ddf-4d4d-8561-26f797b16e15 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1345 microversion: 2.1 time: 0.084948 Dec 23 11:59:31.842548 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 80/149] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:31 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:32.025958 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f36d801a-f1c6-46a4-8cfb-872fe048d0bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:32.026985 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f36d801a-f1c6-46a4-8cfb-872fe048d0bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:32.033777 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f36d801a-f1c6-46a4-8cfb-872fe048d0bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:32.034483 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f36d801a-f1c6-46a4-8cfb-872fe048d0bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:32.035476 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f36d801a-f1c6-46a4-8cfb-872fe048d0bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:32.036083 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f36d801a-f1c6-46a4-8cfb-872fe048d0bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:32.216151 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f36d801a-f1c6-46a4-8cfb-872fe048d0bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 14 microversion: 2.20 time: 0.194094 Dec 23 11:59:32.216809 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 70/150] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:32 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:32.268516 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3dcd8fbb-6eb5-4597-93c2-f35340825521 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:32.269127 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3dcd8fbb-6eb5-4597-93c2-f35340825521 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:32.276153 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3dcd8fbb-6eb5-4597-93c2-f35340825521 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:32.276606 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3dcd8fbb-6eb5-4597-93c2-f35340825521 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:32.277399 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3dcd8fbb-6eb5-4597-93c2-f35340825521 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:32.278054 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3dcd8fbb-6eb5-4597-93c2-f35340825521 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:32.353296 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3dcd8fbb-6eb5-4597-93c2-f35340825521 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:32.364859 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3dcd8fbb-6eb5-4597-93c2-f35340825521 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1271 microversion: 2.1 time: 0.099863 Dec 23 11:59:32.365436 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 81/151] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:32 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:32.722831 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3a4a2da8-431a-419b-8e3a-51f4013ef62d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:32.723525 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3a4a2da8-431a-419b-8e3a-51f4013ef62d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:32.731375 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3a4a2da8-431a-419b-8e3a-51f4013ef62d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:32.732006 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3a4a2da8-431a-419b-8e3a-51f4013ef62d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:32.732975 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3a4a2da8-431a-419b-8e3a-51f4013ef62d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:32.733510 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3a4a2da8-431a-419b-8e3a-51f4013ef62d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:32.860334 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-dee45288-126a-4381-b210-5a64136b3d34 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:32.860978 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-dee45288-126a-4381-b210-5a64136b3d34 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:32.867857 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dee45288-126a-4381-b210-5a64136b3d34 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:32.868317 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dee45288-126a-4381-b210-5a64136b3d34 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:32.869086 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dee45288-126a-4381-b210-5a64136b3d34 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:32.869544 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dee45288-126a-4381-b210-5a64136b3d34 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:32.952838 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-dee45288-126a-4381-b210-5a64136b3d34 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:32.960851 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-dee45288-126a-4381-b210-5a64136b3d34 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1345 microversion: 2.1 time: 0.104368 Dec 23 11:59:32.961503 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 82/152] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:32 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:32.982081 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3a4a2da8-431a-419b-8e3a-51f4013ef62d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:32.990186 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3a4a2da8-431a-419b-8e3a-51f4013ef62d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.271477 Dec 23 11:59:32.990800 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 71/153] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:32 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:33.227914 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2506f913-e3bd-4da9-9707-f443a4960345 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:33.228969 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2506f913-e3bd-4da9-9707-f443a4960345 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:33.237526 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2506f913-e3bd-4da9-9707-f443a4960345 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:33.238136 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2506f913-e3bd-4da9-9707-f443a4960345 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:33.239031 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2506f913-e3bd-4da9-9707-f443a4960345 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:33.239629 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2506f913-e3bd-4da9-9707-f443a4960345 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:33.381130 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-734c8628-bcaa-4af1-a92f-2970b4ccfa13 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:33.381862 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-734c8628-bcaa-4af1-a92f-2970b4ccfa13 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:33.389083 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-734c8628-bcaa-4af1-a92f-2970b4ccfa13 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:33.389522 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-734c8628-bcaa-4af1-a92f-2970b4ccfa13 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:33.390310 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-734c8628-bcaa-4af1-a92f-2970b4ccfa13 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:33.390773 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-734c8628-bcaa-4af1-a92f-2970b4ccfa13 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:33.557497 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-734c8628-bcaa-4af1-a92f-2970b4ccfa13 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:33.565890 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-734c8628-bcaa-4af1-a92f-2970b4ccfa13 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.188328 Dec 23 11:59:33.566898 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 72/154] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:33 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:59:33.751033 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-def5b895-62df-46d8-a120-d2b3b3feb9c0 req-c94d0b30-16ac-4a11-87e8-03d49e16d264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0ae9f51-c8c9-4ae9-bc69-3a953763e90d", "tag": "a1ba6b3d-eecc-454c-b417-768470bc0893"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:33.751033 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:59:33.751033 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 11:59:33.753321 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-def5b895-62df-46d8-a120-d2b3b3feb9c0 req-c94d0b30-16ac-4a11-87e8-03d49e16d264 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:33.753839 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-def5b895-62df-46d8-a120-d2b3b3feb9c0 req-c94d0b30-16ac-4a11-87e8-03d49e16d264 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:33.766106 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-def5b895-62df-46d8-a120-d2b3b3feb9c0 req-c94d0b30-16ac-4a11-87e8-03d49e16d264 service nova] Creating event network-changed:a1ba6b3d-eecc-454c-b417-768470bc0893 for instance f0ae9f51-c8c9-4ae9-bc69-3a953763e90d on hv-cinder-82282 Dec 23 11:59:33.770776 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-def5b895-62df-46d8-a120-d2b3b3feb9c0 req-c94d0b30-16ac-4a11-87e8-03d49e16d264 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031536 Dec 23 11:59:33.771917 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 73/155] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 11:59:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 11:59:33.981114 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0d063363-481c-4d94-8823-b2b80fd3d80f tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:33.981738 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0d063363-481c-4d94-8823-b2b80fd3d80f tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:33.988790 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0d063363-481c-4d94-8823-b2b80fd3d80f tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:33.989244 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0d063363-481c-4d94-8823-b2b80fd3d80f tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:33.990018 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0d063363-481c-4d94-8823-b2b80fd3d80f tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:33.990447 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0d063363-481c-4d94-8823-b2b80fd3d80f tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:34.050978 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0d063363-481c-4d94-8823-b2b80fd3d80f tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:34.059450 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0d063363-481c-4d94-8823-b2b80fd3d80f tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1345 microversion: 2.1 time: 0.084725 Dec 23 11:59:34.060009 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 74/156] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:33 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:34.064199 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-89699f3b-691f-425d-b3b1-b21c949c43ec tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:34.064799 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-89699f3b-691f-425d-b3b1-b21c949c43ec tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:34.070851 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-89699f3b-691f-425d-b3b1-b21c949c43ec tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:34.071308 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-89699f3b-691f-425d-b3b1-b21c949c43ec tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:34.072082 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-89699f3b-691f-425d-b3b1-b21c949c43ec tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:34.072518 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-89699f3b-691f-425d-b3b1-b21c949c43ec tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:34.210838 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-89699f3b-691f-425d-b3b1-b21c949c43ec tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:34.218751 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-89699f3b-691f-425d-b3b1-b21c949c43ec tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.157728 Dec 23 11:59:34.219327 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 75/157] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:34 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:34.586001 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d797b382-f5e2-43e8-8473-12b376159acc tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:34.586971 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d797b382-f5e2-43e8-8473-12b376159acc tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:34.597372 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d797b382-f5e2-43e8-8473-12b376159acc tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:34.598075 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d797b382-f5e2-43e8-8473-12b376159acc tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:34.599333 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d797b382-f5e2-43e8-8473-12b376159acc tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:34.600009 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d797b382-f5e2-43e8-8473-12b376159acc tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:34.734799 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-d797b382-f5e2-43e8-8473-12b376159acc tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:34.746047 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d797b382-f5e2-43e8-8473-12b376159acc tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.165568 Dec 23 11:59:34.746671 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 76/158] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:34 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:35.079938 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-da829ff2-64dc-4b1b-9cad-2a23d422e3be tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:35.080994 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-da829ff2-64dc-4b1b-9cad-2a23d422e3be tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:35.091313 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-da829ff2-64dc-4b1b-9cad-2a23d422e3be tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:35.091761 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-da829ff2-64dc-4b1b-9cad-2a23d422e3be tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:35.092559 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-da829ff2-64dc-4b1b-9cad-2a23d422e3be tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:35.092992 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-da829ff2-64dc-4b1b-9cad-2a23d422e3be tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:35.159383 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-da829ff2-64dc-4b1b-9cad-2a23d422e3be tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:35.167550 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-da829ff2-64dc-4b1b-9cad-2a23d422e3be tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1345 microversion: 2.1 time: 0.094165 Dec 23 11:59:35.168195 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 77/159] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:35 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:35.238829 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0b9cb2e1-ad67-4497-99ae-884c2971ce1c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:35.239825 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0b9cb2e1-ad67-4497-99ae-884c2971ce1c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:35.250345 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0b9cb2e1-ad67-4497-99ae-884c2971ce1c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:35.251141 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0b9cb2e1-ad67-4497-99ae-884c2971ce1c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:35.252467 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0b9cb2e1-ad67-4497-99ae-884c2971ce1c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:35.253211 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0b9cb2e1-ad67-4497-99ae-884c2971ce1c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:35.392221 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0b9cb2e1-ad67-4497-99ae-884c2971ce1c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:35.399612 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0b9cb2e1-ad67-4497-99ae-884c2971ce1c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.167051 Dec 23 11:59:35.400175 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 78/160] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:35 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:35.767472 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-462897a3-d717-4393-bade-930c87bbd640 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:35.768594 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-462897a3-d717-4393-bade-930c87bbd640 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:35.779446 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-462897a3-d717-4393-bade-930c87bbd640 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:35.780137 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-462897a3-d717-4393-bade-930c87bbd640 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:35.781266 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-462897a3-d717-4393-bade-930c87bbd640 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:35.781702 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-462897a3-d717-4393-bade-930c87bbd640 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:35.915119 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-462897a3-d717-4393-bade-930c87bbd640 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:35.924629 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-462897a3-d717-4393-bade-930c87bbd640 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.163476 Dec 23 11:59:35.925340 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 79/161] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:35 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:36.186435 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2bf1ff15-09dc-4ae4-8349-a86331f876b3 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:36.187312 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2bf1ff15-09dc-4ae4-8349-a86331f876b3 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:36.196016 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2bf1ff15-09dc-4ae4-8349-a86331f876b3 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:36.196658 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2bf1ff15-09dc-4ae4-8349-a86331f876b3 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:36.197719 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2bf1ff15-09dc-4ae4-8349-a86331f876b3 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:36.198315 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2bf1ff15-09dc-4ae4-8349-a86331f876b3 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:36.257955 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2bf1ff15-09dc-4ae4-8349-a86331f876b3 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:36.266431 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2bf1ff15-09dc-4ae4-8349-a86331f876b3 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1345 microversion: 2.1 time: 0.085372 Dec 23 11:59:36.267038 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 80/162] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:36 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:36.422005 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ee365823-550f-405d-b7dd-aac6b9f236f5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:36.422659 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ee365823-550f-405d-b7dd-aac6b9f236f5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:36.429048 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ee365823-550f-405d-b7dd-aac6b9f236f5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:36.429497 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ee365823-550f-405d-b7dd-aac6b9f236f5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:36.430260 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ee365823-550f-405d-b7dd-aac6b9f236f5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:36.430725 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ee365823-550f-405d-b7dd-aac6b9f236f5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:36.575116 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ee365823-550f-405d-b7dd-aac6b9f236f5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:36.582885 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ee365823-550f-405d-b7dd-aac6b9f236f5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.164591 Dec 23 11:59:36.583462 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 81/163] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:36 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:36.943462 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5d03e641-e8cf-4642-b458-d105647fe488 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:36.944079 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5d03e641-e8cf-4642-b458-d105647fe488 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:36.950844 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5d03e641-e8cf-4642-b458-d105647fe488 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:36.951501 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5d03e641-e8cf-4642-b458-d105647fe488 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:36.952896 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5d03e641-e8cf-4642-b458-d105647fe488 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:36.953340 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5d03e641-e8cf-4642-b458-d105647fe488 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:37.089855 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-5d03e641-e8cf-4642-b458-d105647fe488 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:37.097568 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5d03e641-e8cf-4642-b458-d105647fe488 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.157742 Dec 23 11:59:37.098142 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 82/164] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:36 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:37.289400 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a5f2ad28-4097-4e19-871c-05b96e7df558 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:37.290243 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a5f2ad28-4097-4e19-871c-05b96e7df558 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:37.299272 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a5f2ad28-4097-4e19-871c-05b96e7df558 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:37.299977 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a5f2ad28-4097-4e19-871c-05b96e7df558 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:37.301020 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a5f2ad28-4097-4e19-871c-05b96e7df558 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:37.301609 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a5f2ad28-4097-4e19-871c-05b96e7df558 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:37.364517 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-a5f2ad28-4097-4e19-871c-05b96e7df558 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:37.372891 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a5f2ad28-4097-4e19-871c-05b96e7df558 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1345 microversion: 2.1 time: 0.089017 Dec 23 11:59:37.373449 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 83/165] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:37 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:37.589274 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2506f913-e3bd-4da9-9707-f443a4960345 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 14 microversion: 2.20 time: 4.364480 Dec 23 11:59:37.590228 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 83/166] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:33 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 14 bytes in 4367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:37.603566 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3363fd0c-e67b-4455-a522-e377a2664910 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:37.604721 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3363fd0c-e67b-4455-a522-e377a2664910 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:37.612842 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3363fd0c-e67b-4455-a522-e377a2664910 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:37.613372 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3363fd0c-e67b-4455-a522-e377a2664910 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:37.614203 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3363fd0c-e67b-4455-a522-e377a2664910 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:37.614781 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3363fd0c-e67b-4455-a522-e377a2664910 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:38.053100 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3363fd0c-e67b-4455-a522-e377a2664910 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:38.061987 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3363fd0c-e67b-4455-a522-e377a2664910 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.464343 Dec 23 11:59:38.063110 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 84/167] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:37 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:38.114754 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e3af0edf-c1b5-44e9-a331-dc974ae10227 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:38.115461 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e3af0edf-c1b5-44e9-a331-dc974ae10227 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:38.122776 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e3af0edf-c1b5-44e9-a331-dc974ae10227 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:38.123215 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e3af0edf-c1b5-44e9-a331-dc974ae10227 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:38.124041 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e3af0edf-c1b5-44e9-a331-dc974ae10227 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:38.124475 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e3af0edf-c1b5-44e9-a331-dc974ae10227 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:38.258548 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e3af0edf-c1b5-44e9-a331-dc974ae10227 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:38.266546 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e3af0edf-c1b5-44e9-a331-dc974ae10227 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.156085 Dec 23 11:59:38.267129 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 84/168] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:38 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:38.389223 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-90fc08e2-8477-4126-bcb4-9817aaf07560 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:38.389925 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-90fc08e2-8477-4126-bcb4-9817aaf07560 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:38.396738 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-90fc08e2-8477-4126-bcb4-9817aaf07560 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:38.397190 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-90fc08e2-8477-4126-bcb4-9817aaf07560 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:38.397961 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-90fc08e2-8477-4126-bcb4-9817aaf07560 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:38.398456 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-90fc08e2-8477-4126-bcb4-9817aaf07560 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:38.428450 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-90fc08e2-8477-4126-bcb4-9817aaf07560 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:38.428900 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-90fc08e2-8477-4126-bcb4-9817aaf07560 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:38.429350 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-90fc08e2-8477-4126-bcb4-9817aaf07560 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lazy-loading 'fault' on Instance uuid 518c84e9-aab7-44b1-b614-30ffee393824 {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 11:59:38.476890 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-90fc08e2-8477-4126-bcb4-9817aaf07560 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:38.485095 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-90fc08e2-8477-4126-bcb4-9817aaf07560 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1350 microversion: 2.1 time: 0.099553 Dec 23 11:59:38.485676 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 85/169] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:38 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:38.602363 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3aa558ba-547d-4c1f-8000-71333758c790 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:38.603350 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3aa558ba-547d-4c1f-8000-71333758c790 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:38.610390 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3aa558ba-547d-4c1f-8000-71333758c790 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:38.611039 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3aa558ba-547d-4c1f-8000-71333758c790 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:38.612189 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3aa558ba-547d-4c1f-8000-71333758c790 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:38.612624 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3aa558ba-547d-4c1f-8000-71333758c790 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:39.081184 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-977a78a7-37cd-48cb-85a6-123980bb323a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:39.081795 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-977a78a7-37cd-48cb-85a6-123980bb323a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:39.088192 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-977a78a7-37cd-48cb-85a6-123980bb323a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:39.088643 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-977a78a7-37cd-48cb-85a6-123980bb323a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:39.089431 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-977a78a7-37cd-48cb-85a6-123980bb323a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:39.089867 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-977a78a7-37cd-48cb-85a6-123980bb323a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:39.225991 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-977a78a7-37cd-48cb-85a6-123980bb323a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:39.237218 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-977a78a7-37cd-48cb-85a6-123980bb323a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.160616 Dec 23 11:59:39.237822 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 86/170] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:39 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:39.283153 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3afc9382-1602-4bef-a321-5e4623c9e059 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:39.283787 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3afc9382-1602-4bef-a321-5e4623c9e059 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:39.289937 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3afc9382-1602-4bef-a321-5e4623c9e059 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:39.290392 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3afc9382-1602-4bef-a321-5e4623c9e059 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:39.291202 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3afc9382-1602-4bef-a321-5e4623c9e059 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:39.291640 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3afc9382-1602-4bef-a321-5e4623c9e059 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:39.429646 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3afc9382-1602-4bef-a321-5e4623c9e059 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:39.439281 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3afc9382-1602-4bef-a321-5e4623c9e059 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.159961 Dec 23 11:59:39.439823 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 87/171] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:39 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:39.501719 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-26523a44-3772-4c30-93a3-ebef11161562 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:39.502447 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-26523a44-3772-4c30-93a3-ebef11161562 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:39.509272 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26523a44-3772-4c30-93a3-ebef11161562 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:39.509762 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26523a44-3772-4c30-93a3-ebef11161562 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:39.510533 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26523a44-3772-4c30-93a3-ebef11161562 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:39.511020 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26523a44-3772-4c30-93a3-ebef11161562 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:39.541956 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26523a44-3772-4c30-93a3-ebef11161562 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:39.542321 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26523a44-3772-4c30-93a3-ebef11161562 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:39.542805 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-26523a44-3772-4c30-93a3-ebef11161562 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lazy-loading 'fault' on Instance uuid 518c84e9-aab7-44b1-b614-30ffee393824 {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 11:59:39.581266 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-26523a44-3772-4c30-93a3-ebef11161562 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:39.589162 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-26523a44-3772-4c30-93a3-ebef11161562 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1350 microversion: 2.1 time: 0.091200 Dec 23 11:59:39.589716 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 88/172] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:39 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:40.258123 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-efa4ea46-6ae7-4b31-907e-997618519a3a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:40.259207 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-efa4ea46-6ae7-4b31-907e-997618519a3a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:40.269881 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-efa4ea46-6ae7-4b31-907e-997618519a3a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:40.270686 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-efa4ea46-6ae7-4b31-907e-997618519a3a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:40.272032 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-efa4ea46-6ae7-4b31-907e-997618519a3a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:40.272693 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-efa4ea46-6ae7-4b31-907e-997618519a3a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:40.411859 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-efa4ea46-6ae7-4b31-907e-997618519a3a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:40.419365 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-efa4ea46-6ae7-4b31-907e-997618519a3a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.167452 Dec 23 11:59:40.419946 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 89/173] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:40 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:40.455149 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3d2d269f-411e-4a04-a9f1-5637495582c0 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:40.455771 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3d2d269f-411e-4a04-a9f1-5637495582c0 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:40.461528 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3d2d269f-411e-4a04-a9f1-5637495582c0 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:40.461989 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3d2d269f-411e-4a04-a9f1-5637495582c0 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:40.462793 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3d2d269f-411e-4a04-a9f1-5637495582c0 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:40.463233 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3d2d269f-411e-4a04-a9f1-5637495582c0 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:40.603689 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3d2d269f-411e-4a04-a9f1-5637495582c0 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:40.611830 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3d2d269f-411e-4a04-a9f1-5637495582c0 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.159909 Dec 23 11:59:40.612378 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 90/174] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:40 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:40.616531 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-19350901-2613-44b7-8103-a77d5d082de0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:40.617138 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-19350901-2613-44b7-8103-a77d5d082de0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:40.623039 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-19350901-2613-44b7-8103-a77d5d082de0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:40.623476 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-19350901-2613-44b7-8103-a77d5d082de0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:40.624782 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-19350901-2613-44b7-8103-a77d5d082de0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:40.625253 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-19350901-2613-44b7-8103-a77d5d082de0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:40.659071 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-19350901-2613-44b7-8103-a77d5d082de0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:40.659523 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-19350901-2613-44b7-8103-a77d5d082de0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:40.659972 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-19350901-2613-44b7-8103-a77d5d082de0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lazy-loading 'fault' on Instance uuid 518c84e9-aab7-44b1-b614-30ffee393824 {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 11:59:40.698235 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-19350901-2613-44b7-8103-a77d5d082de0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:40.706988 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-19350901-2613-44b7-8103-a77d5d082de0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1350 microversion: 2.1 time: 0.093615 Dec 23 11:59:40.707556 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 91/175] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:40 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:41.440569 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-dc3bffbb-c867-451d-89e7-1f91c4426ef0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:41.441613 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-dc3bffbb-c867-451d-89e7-1f91c4426ef0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:41.452229 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-dc3bffbb-c867-451d-89e7-1f91c4426ef0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:41.452710 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-dc3bffbb-c867-451d-89e7-1f91c4426ef0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:41.453679 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-dc3bffbb-c867-451d-89e7-1f91c4426ef0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:41.454106 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-dc3bffbb-c867-451d-89e7-1f91c4426ef0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:41.589080 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-dc3bffbb-c867-451d-89e7-1f91c4426ef0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:41.597585 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-dc3bffbb-c867-451d-89e7-1f91c4426ef0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.163172 Dec 23 11:59:41.598156 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 92/176] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:41 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:41.630255 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-cc398743-0441-496a-bcbb-962486973d7c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:41.631007 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-cc398743-0441-496a-bcbb-962486973d7c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:41.639418 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cc398743-0441-496a-bcbb-962486973d7c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:41.640251 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cc398743-0441-496a-bcbb-962486973d7c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:41.641097 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cc398743-0441-496a-bcbb-962486973d7c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:41.641674 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cc398743-0441-496a-bcbb-962486973d7c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:41.791767 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-cc398743-0441-496a-bcbb-962486973d7c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:41.802828 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-cc398743-0441-496a-bcbb-962486973d7c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.178003 Dec 23 11:59:41.803628 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 93/177] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:41 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:59:41.807862 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a43e850d-2a6d-47e1-8a7d-06096967729d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:41.808463 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a43e850d-2a6d-47e1-8a7d-06096967729d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:41.814675 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a43e850d-2a6d-47e1-8a7d-06096967729d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:41.815120 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a43e850d-2a6d-47e1-8a7d-06096967729d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:41.815890 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a43e850d-2a6d-47e1-8a7d-06096967729d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:41.816347 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a43e850d-2a6d-47e1-8a7d-06096967729d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:41.851551 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a43e850d-2a6d-47e1-8a7d-06096967729d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:41.852000 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a43e850d-2a6d-47e1-8a7d-06096967729d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:41.852445 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-a43e850d-2a6d-47e1-8a7d-06096967729d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lazy-loading 'fault' on Instance uuid 518c84e9-aab7-44b1-b614-30ffee393824 {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 11:59:41.899774 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-a43e850d-2a6d-47e1-8a7d-06096967729d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b39dd77d85e4eb1bc76c00e071e97c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf852b4ffd784cc6a4c15059be11f5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:41.908422 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a43e850d-2a6d-47e1-8a7d-06096967729d tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 200 len: 1350 microversion: 2.1 time: 0.103850 Dec 23 11:59:41.908984 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 94/178] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:41 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:42.400630 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3aa558ba-547d-4c1f-8000-71333758c790 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 14 microversion: 2.20 time: 3.802100 Dec 23 11:59:42.401158 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 85/179] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:38 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 14 bytes in 3804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:42.614855 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7713fb61-627e-4f5d-a97d-254ed8e27359 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:42.615469 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-7713fb61-627e-4f5d-a97d-254ed8e27359 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:42.622123 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7713fb61-627e-4f5d-a97d-254ed8e27359 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:42.622851 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7713fb61-627e-4f5d-a97d-254ed8e27359 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:42.624958 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7713fb61-627e-4f5d-a97d-254ed8e27359 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:42.624958 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7713fb61-627e-4f5d-a97d-254ed8e27359 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:42.820316 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3f90a955-a5fb-42c1-b78d-b8c1376e46ae tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:42.821027 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3f90a955-a5fb-42c1-b78d-b8c1376e46ae tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:42.829623 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3f90a955-a5fb-42c1-b78d-b8c1376e46ae tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:42.830083 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3f90a955-a5fb-42c1-b78d-b8c1376e46ae tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:42.830912 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3f90a955-a5fb-42c1-b78d-b8c1376e46ae tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:42.831352 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3f90a955-a5fb-42c1-b78d-b8c1376e46ae tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:42.957451 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-7713fb61-627e-4f5d-a97d-254ed8e27359 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:42.966757 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-7713fb61-627e-4f5d-a97d-254ed8e27359 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.355690 Dec 23 11:59:42.967959 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 95/180] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:42 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:42.972752 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b3ae2cb8-b745-4eed-af71-a6eb2208a1ad tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:42.973528 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b3ae2cb8-b745-4eed-af71-a6eb2208a1ad tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:42.980275 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b3ae2cb8-b745-4eed-af71-a6eb2208a1ad tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:42.980802 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b3ae2cb8-b745-4eed-af71-a6eb2208a1ad tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:42.981675 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b3ae2cb8-b745-4eed-af71-a6eb2208a1ad tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:42.982156 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b3ae2cb8-b745-4eed-af71-a6eb2208a1ad tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:43.000773 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-b3ae2cb8-b745-4eed-af71-a6eb2208a1ad tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] HTTP exception thrown: Instance 518c84e9-aab7-44b1-b614-30ffee393824 could not be found. Dec 23 11:59:43.001416 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b3ae2cb8-b745-4eed-af71-a6eb2208a1ad tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Returning 404 to user: Instance 518c84e9-aab7-44b1-b614-30ffee393824 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:59:43.002403 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b3ae2cb8-b745-4eed-af71-a6eb2208a1ad tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 404 len: 111 microversion: 2.1 time: 0.033247 Dec 23 11:59:43.002917 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 96/181] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:42 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 11:59:43.103857 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3f90a955-a5fb-42c1-b78d-b8c1376e46ae tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:43.108944 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-048dcaf3-5411-483d-b6dc-ecb3bc6e91f0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:43.110000 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-048dcaf3-5411-483d-b6dc-ecb3bc6e91f0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:43.116599 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-048dcaf3-5411-483d-b6dc-ecb3bc6e91f0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:43.116805 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3f90a955-a5fb-42c1-b78d-b8c1376e46ae tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.300473 Dec 23 11:59:43.117046 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-048dcaf3-5411-483d-b6dc-ecb3bc6e91f0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:43.117443 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 86/182] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:42 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:59:43.117827 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-048dcaf3-5411-483d-b6dc-ecb3bc6e91f0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:43.118326 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-048dcaf3-5411-483d-b6dc-ecb3bc6e91f0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:43.132291 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-048dcaf3-5411-483d-b6dc-ecb3bc6e91f0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] HTTP exception thrown: Instance 518c84e9-aab7-44b1-b614-30ffee393824 could not be found. Dec 23 11:59:43.132879 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-048dcaf3-5411-483d-b6dc-ecb3bc6e91f0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Returning 404 to user: Instance 518c84e9-aab7-44b1-b614-30ffee393824 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:59:43.133702 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-048dcaf3-5411-483d-b6dc-ecb3bc6e91f0 tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028719 Dec 23 11:59:43.134303 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 97/183] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 11:59:43 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 11:59:43.412456 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-01b290cd-b46e-4fcd-a51d-f9cea99e040d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:43.413419 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-01b290cd-b46e-4fcd-a51d-f9cea99e040d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:43.420773 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-01b290cd-b46e-4fcd-a51d-f9cea99e040d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:43.421288 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-01b290cd-b46e-4fcd-a51d-f9cea99e040d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:43.422228 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-01b290cd-b46e-4fcd-a51d-f9cea99e040d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:43.422699 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-01b290cd-b46e-4fcd-a51d-f9cea99e040d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:43.565173 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-01b290cd-b46e-4fcd-a51d-f9cea99e040d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 14 microversion: 2.20 time: 0.156541 Dec 23 11:59:43.565842 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 87/184] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:43 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:43.984871 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2859fcd8-4fcf-4420-8cc1-4c748f5634e9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:43.985492 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2859fcd8-4fcf-4420-8cc1-4c748f5634e9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:43.992110 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2859fcd8-4fcf-4420-8cc1-4c748f5634e9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:43.992636 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2859fcd8-4fcf-4420-8cc1-4c748f5634e9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:43.993440 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2859fcd8-4fcf-4420-8cc1-4c748f5634e9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:43.993870 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2859fcd8-4fcf-4420-8cc1-4c748f5634e9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:44.133366 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-9cbbd833-a65a-4a7f-8d0f-e88244140134 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:44.137195 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-9cbbd833-a65a-4a7f-8d0f-e88244140134 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:44.146240 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9cbbd833-a65a-4a7f-8d0f-e88244140134 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:44.147058 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9cbbd833-a65a-4a7f-8d0f-e88244140134 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:44.148508 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9cbbd833-a65a-4a7f-8d0f-e88244140134 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:44.149341 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9cbbd833-a65a-4a7f-8d0f-e88244140134 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:44.152732 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2859fcd8-4fcf-4420-8cc1-4c748f5634e9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:44.161754 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2859fcd8-4fcf-4420-8cc1-4c748f5634e9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.181306 Dec 23 11:59:44.171726 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 98/185] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:43 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:44.310198 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-9cbbd833-a65a-4a7f-8d0f-e88244140134 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:44.321198 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-9cbbd833-a65a-4a7f-8d0f-e88244140134 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.191620 Dec 23 11:59:44.328263 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 88/186] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:44 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:59:44.576937 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a514b058-8e3c-40c4-a38a-e7b56a0df619 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:44.578421 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a514b058-8e3c-40c4-a38a-e7b56a0df619 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:44.586031 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a514b058-8e3c-40c4-a38a-e7b56a0df619 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:44.586724 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a514b058-8e3c-40c4-a38a-e7b56a0df619 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:44.588341 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a514b058-8e3c-40c4-a38a-e7b56a0df619 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:44.588893 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a514b058-8e3c-40c4-a38a-e7b56a0df619 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:44.744288 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a514b058-8e3c-40c4-a38a-e7b56a0df619 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 14 microversion: 2.20 time: 0.171567 Dec 23 11:59:44.747627 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 99/187] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:44 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:45.177820 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d182f03c-9170-4689-ab18-717908797def tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:45.178437 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d182f03c-9170-4689-ab18-717908797def tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:45.185063 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d182f03c-9170-4689-ab18-717908797def tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:45.185509 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d182f03c-9170-4689-ab18-717908797def tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:45.186313 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d182f03c-9170-4689-ab18-717908797def tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:45.186797 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d182f03c-9170-4689-ab18-717908797def tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:45.343568 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-92516408-aaf1-4311-813f-04fbdce115c0 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:45.344275 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-92516408-aaf1-4311-813f-04fbdce115c0 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:45.351239 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-92516408-aaf1-4311-813f-04fbdce115c0 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:45.351697 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-92516408-aaf1-4311-813f-04fbdce115c0 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:45.352479 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-92516408-aaf1-4311-813f-04fbdce115c0 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:45.352905 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-92516408-aaf1-4311-813f-04fbdce115c0 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:45.368906 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d182f03c-9170-4689-ab18-717908797def tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:45.383417 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d182f03c-9170-4689-ab18-717908797def tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.209138 Dec 23 11:59:45.384939 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 89/188] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:45 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:45.400422 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0ae3f524-b90a-41db-be96-aca7f2c490af tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:45.401815 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0ae3f524-b90a-41db-be96-aca7f2c490af tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:45.410433 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0ae3f524-b90a-41db-be96-aca7f2c490af tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:45.411064 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0ae3f524-b90a-41db-be96-aca7f2c490af tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:45.411920 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0ae3f524-b90a-41db-be96-aca7f2c490af tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:45.412483 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0ae3f524-b90a-41db-be96-aca7f2c490af tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:45.426694 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-0ae3f524-b90a-41db-be96-aca7f2c490af tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] HTTP exception thrown: Instance 518c84e9-aab7-44b1-b614-30ffee393824 could not be found. Dec 23 11:59:45.427376 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0ae3f524-b90a-41db-be96-aca7f2c490af tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Returning 404 to user: Instance 518c84e9-aab7-44b1-b614-30ffee393824 could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:59:45.428370 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0ae3f524-b90a-41db-be96-aca7f2c490af tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "DELETE /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 404 len: 111 microversion: 2.1 time: 0.032342 Dec 23 11:59:45.429113 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 90/189] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 11:59:45 2021] DELETE /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 23 11:59:45.436964 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-792249d4-95cc-447d-a717-7df8824389ce tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:45.437658 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-792249d4-95cc-447d-a717-7df8824389ce tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] [instance: 518c84e9-aab7-44b1-b614-30ffee393824] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:45.444144 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-792249d4-95cc-447d-a717-7df8824389ce tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:45.444788 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-792249d4-95cc-447d-a717-7df8824389ce tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:45.445771 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-792249d4-95cc-447d-a717-7df8824389ce tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:45.446215 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-792249d4-95cc-447d-a717-7df8824389ce tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:45.460260 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-792249d4-95cc-447d-a717-7df8824389ce tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] HTTP exception thrown: Instance 518c84e9-aab7-44b1-b614-30ffee393824 could not be found. Dec 23 11:59:45.460850 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-792249d4-95cc-447d-a717-7df8824389ce tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] Returning 404 to user: Instance 518c84e9-aab7-44b1-b614-30ffee393824 could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 11:59:45.461853 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-792249d4-95cc-447d-a717-7df8824389ce tempest-DeleteServersTestJSON-1808593601 tempest-DeleteServersTestJSON-1808593601-project] 10.222.0.65 "GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824" status: 404 len: 111 microversion: 2.1 time: 0.028728 Dec 23 11:59:45.462741 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 91/190] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:45 2021] GET /compute/v2.1/servers/518c84e9-aab7-44b1-b614-30ffee393824 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 23 11:59:45.527117 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-92516408-aaf1-4311-813f-04fbdce115c0 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:45.535182 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-92516408-aaf1-4311-813f-04fbdce115c0 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.197440 Dec 23 11:59:45.544320 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 100/191] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:45 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:45.755536 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-da52a9cf-573e-4840-8ca3-494843b2c44d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:45.756683 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-da52a9cf-573e-4840-8ca3-494843b2c44d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:45.763072 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-da52a9cf-573e-4840-8ca3-494843b2c44d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:45.763514 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-da52a9cf-573e-4840-8ca3-494843b2c44d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:45.764271 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-da52a9cf-573e-4840-8ca3-494843b2c44d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:45.764962 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-da52a9cf-573e-4840-8ca3-494843b2c44d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:45.930779 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-da52a9cf-573e-4840-8ca3-494843b2c44d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 3903 microversion: 2.20 time: 0.178487 Dec 23 11:59:45.931899 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 92/192] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:45 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 3903 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 11:59:46.401590 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e21e164d-fe4a-44ae-8a09-476e0051dfa3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:46.402195 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e21e164d-fe4a-44ae-8a09-476e0051dfa3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:46.410417 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e21e164d-fe4a-44ae-8a09-476e0051dfa3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:46.414454 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e21e164d-fe4a-44ae-8a09-476e0051dfa3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:46.415632 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e21e164d-fe4a-44ae-8a09-476e0051dfa3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:46.416215 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e21e164d-fe4a-44ae-8a09-476e0051dfa3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:46.554127 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8e3423a2-8bee-4dde-ac44-e9d63a0772b3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:46.554853 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-8e3423a2-8bee-4dde-ac44-e9d63a0772b3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:46.567585 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8e3423a2-8bee-4dde-ac44-e9d63a0772b3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:46.568034 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8e3423a2-8bee-4dde-ac44-e9d63a0772b3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:46.568881 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8e3423a2-8bee-4dde-ac44-e9d63a0772b3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:46.569409 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8e3423a2-8bee-4dde-ac44-e9d63a0772b3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:46.695711 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e21e164d-fe4a-44ae-8a09-476e0051dfa3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:46.704114 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e21e164d-fe4a-44ae-8a09-476e0051dfa3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.306288 Dec 23 11:59:46.708550 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 101/193] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:46 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:46.795319 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-8e3423a2-8bee-4dde-ac44-e9d63a0772b3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:46.802968 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-8e3423a2-8bee-4dde-ac44-e9d63a0772b3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.253644 Dec 23 11:59:46.803530 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 93/194] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:46 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:46.941238 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ba6a1024-daac-4f3c-9d19-184ab7cd8fbb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:46.942152 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ba6a1024-daac-4f3c-9d19-184ab7cd8fbb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:46.948162 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ba6a1024-daac-4f3c-9d19-184ab7cd8fbb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:46.948719 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ba6a1024-daac-4f3c-9d19-184ab7cd8fbb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:46.949557 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ba6a1024-daac-4f3c-9d19-184ab7cd8fbb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:46.950050 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ba6a1024-daac-4f3c-9d19-184ab7cd8fbb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:47.098185 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ba6a1024-daac-4f3c-9d19-184ab7cd8fbb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 7357 microversion: 2.20 time: 0.160385 Dec 23 11:59:47.099471 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 102/195] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:46 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 7357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 11:59:47.721263 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b7c7ce45-b148-4f0e-85a9-727da0140632 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:47.721907 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b7c7ce45-b148-4f0e-85a9-727da0140632 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:47.730911 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b7c7ce45-b148-4f0e-85a9-727da0140632 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:47.731298 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b7c7ce45-b148-4f0e-85a9-727da0140632 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:47.733264 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b7c7ce45-b148-4f0e-85a9-727da0140632 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:47.733935 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b7c7ce45-b148-4f0e-85a9-727da0140632 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:47.825886 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9530a16a-f4d9-43df-a948-a43b9c986145 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:47.827690 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9530a16a-f4d9-43df-a948-a43b9c986145 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:47.836222 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9530a16a-f4d9-43df-a948-a43b9c986145 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:47.836827 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9530a16a-f4d9-43df-a948-a43b9c986145 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:47.837928 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9530a16a-f4d9-43df-a948-a43b9c986145 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:47.838502 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9530a16a-f4d9-43df-a948-a43b9c986145 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:47.981985 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b7c7ce45-b148-4f0e-85a9-727da0140632 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:47.991336 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b7c7ce45-b148-4f0e-85a9-727da0140632 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.273787 Dec 23 11:59:47.991959 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 94/196] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:47 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:48.106287 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9530a16a-f4d9-43df-a948-a43b9c986145 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:48.110465 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-71ab94b1-4466-4d65-98e9-5215d0d38f57 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:48.111959 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-71ab94b1-4466-4d65-98e9-5215d0d38f57 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:48.115611 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9530a16a-f4d9-43df-a948-a43b9c986145 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.299160 Dec 23 11:59:48.118363 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-71ab94b1-4466-4d65-98e9-5215d0d38f57 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:48.119051 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-71ab94b1-4466-4d65-98e9-5215d0d38f57 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:48.119201 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 103/197] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:47 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:48.130230 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-71ab94b1-4466-4d65-98e9-5215d0d38f57 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:48.131856 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-71ab94b1-4466-4d65-98e9-5215d0d38f57 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:48.319596 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-71ab94b1-4466-4d65-98e9-5215d0d38f57 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 10744 microversion: 2.20 time: 0.209202 Dec 23 11:59:48.320083 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 95/198] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:48 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 10744 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 23 11:59:49.008606 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8ac8eab9-ff37-429b-83b6-38754b5a5c79 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:49.009341 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8ac8eab9-ff37-429b-83b6-38754b5a5c79 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:49.016718 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8ac8eab9-ff37-429b-83b6-38754b5a5c79 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:49.017267 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8ac8eab9-ff37-429b-83b6-38754b5a5c79 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:49.018136 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8ac8eab9-ff37-429b-83b6-38754b5a5c79 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:49.018597 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8ac8eab9-ff37-429b-83b6-38754b5a5c79 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:49.136921 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a2cfffbc-303b-4cee-b6c6-c484d897756f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:49.138720 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a2cfffbc-303b-4cee-b6c6-c484d897756f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:49.147372 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a2cfffbc-303b-4cee-b6c6-c484d897756f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:49.147819 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a2cfffbc-303b-4cee-b6c6-c484d897756f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:49.148863 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a2cfffbc-303b-4cee-b6c6-c484d897756f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:49.149398 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a2cfffbc-303b-4cee-b6c6-c484d897756f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:49.267189 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8ac8eab9-ff37-429b-83b6-38754b5a5c79 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:49.280753 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8ac8eab9-ff37-429b-83b6-38754b5a5c79 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.275563 Dec 23 11:59:49.282673 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 104/199] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:49 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:49.325282 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0c90fea5-b50a-4cb1-8cfe-05368e3b2e01 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:49.326844 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0c90fea5-b50a-4cb1-8cfe-05368e3b2e01 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:49.332887 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0c90fea5-b50a-4cb1-8cfe-05368e3b2e01 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:49.333598 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0c90fea5-b50a-4cb1-8cfe-05368e3b2e01 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:49.334819 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0c90fea5-b50a-4cb1-8cfe-05368e3b2e01 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:49.335450 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0c90fea5-b50a-4cb1-8cfe-05368e3b2e01 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:49.400712 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a2cfffbc-303b-4cee-b6c6-c484d897756f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:49.410249 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a2cfffbc-303b-4cee-b6c6-c484d897756f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.277399 Dec 23 11:59:49.411444 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 96/200] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:49 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:49.492586 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0c90fea5-b50a-4cb1-8cfe-05368e3b2e01 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 14250 microversion: 2.20 time: 0.170735 Dec 23 11:59:49.496074 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 105/201] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:49 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 14250 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 23 11:59:50.298947 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2a4b6c10-599a-4e4a-b0b2-e03579b87ba5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:50.299715 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2a4b6c10-599a-4e4a-b0b2-e03579b87ba5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:50.309357 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2a4b6c10-599a-4e4a-b0b2-e03579b87ba5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:50.309807 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2a4b6c10-599a-4e4a-b0b2-e03579b87ba5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:50.310627 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2a4b6c10-599a-4e4a-b0b2-e03579b87ba5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:50.311328 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2a4b6c10-599a-4e4a-b0b2-e03579b87ba5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:50.428794 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-db1068d3-43f1-488d-8549-6ec101cdb8fd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:50.429497 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-db1068d3-43f1-488d-8549-6ec101cdb8fd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:50.438916 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-db1068d3-43f1-488d-8549-6ec101cdb8fd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:50.439624 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-db1068d3-43f1-488d-8549-6ec101cdb8fd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:50.440741 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-db1068d3-43f1-488d-8549-6ec101cdb8fd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:50.441357 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-db1068d3-43f1-488d-8549-6ec101cdb8fd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:50.474698 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-2a4b6c10-599a-4e4a-b0b2-e03579b87ba5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:50.483403 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2a4b6c10-599a-4e4a-b0b2-e03579b87ba5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.188483 Dec 23 11:59:50.484236 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 97/202] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:50 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:50.511371 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2e70ceef-808b-4eb1-818b-46bdc16e9d19 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:50.512300 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2e70ceef-808b-4eb1-818b-46bdc16e9d19 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:50.521422 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2e70ceef-808b-4eb1-818b-46bdc16e9d19 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:50.522066 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2e70ceef-808b-4eb1-818b-46bdc16e9d19 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:50.522932 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2e70ceef-808b-4eb1-818b-46bdc16e9d19 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:50.523525 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2e70ceef-808b-4eb1-818b-46bdc16e9d19 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:50.606951 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-db1068d3-43f1-488d-8549-6ec101cdb8fd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:50.616787 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-db1068d3-43f1-488d-8549-6ec101cdb8fd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.192724 Dec 23 11:59:50.617365 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 106/203] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:50 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:59:50.629458 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-778acb5c-911f-4621-9eb6-ea59d8655f3c req-3a8dada0-d5ce-4888-992c-667113122dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ae9f51-c8c9-4ae9-bc69-3a953763e90d", "name": "network-vif-plugged", "status": "completed", "tag": "a1ba6b3d-eecc-454c-b417-768470bc0893"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:50.631838 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:59:50.631838 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 11:59:50.640385 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-778acb5c-911f-4621-9eb6-ea59d8655f3c req-3a8dada0-d5ce-4888-992c-667113122dcf service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:50.640827 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-778acb5c-911f-4621-9eb6-ea59d8655f3c req-3a8dada0-d5ce-4888-992c-667113122dcf service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:50.654318 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-778acb5c-911f-4621-9eb6-ea59d8655f3c req-3a8dada0-d5ce-4888-992c-667113122dcf service nova] Creating event network-vif-plugged:a1ba6b3d-eecc-454c-b417-768470bc0893 for instance f0ae9f51-c8c9-4ae9-bc69-3a953763e90d on hv-cinder-82282 Dec 23 11:59:50.659475 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-778acb5c-911f-4621-9eb6-ea59d8655f3c req-3a8dada0-d5ce-4888-992c-667113122dcf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035395 Dec 23 11:59:50.660118 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 107/204] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 11:59:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:59:50.697130 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2e70ceef-808b-4eb1-818b-46bdc16e9d19 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 16403 microversion: 2.20 time: 0.189205 Dec 23 11:59:50.697846 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 98/205] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:50 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 16403 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 11:59:51.502024 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-24f69e1b-6f97-4d4c-9e5a-f04a42f1f831 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:51.502780 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-24f69e1b-6f97-4d4c-9e5a-f04a42f1f831 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:51.509201 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-24f69e1b-6f97-4d4c-9e5a-f04a42f1f831 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:51.510125 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-24f69e1b-6f97-4d4c-9e5a-f04a42f1f831 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:51.510948 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-24f69e1b-6f97-4d4c-9e5a-f04a42f1f831 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:51.511886 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-24f69e1b-6f97-4d4c-9e5a-f04a42f1f831 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:51.636824 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-cae99ed9-57db-43ad-994c-2600a44b21a3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:51.639369 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-cae99ed9-57db-43ad-994c-2600a44b21a3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:51.651255 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cae99ed9-57db-43ad-994c-2600a44b21a3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:51.652026 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cae99ed9-57db-43ad-994c-2600a44b21a3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:51.653397 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cae99ed9-57db-43ad-994c-2600a44b21a3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:51.654016 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cae99ed9-57db-43ad-994c-2600a44b21a3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:52.065103 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-cae99ed9-57db-43ad-994c-2600a44b21a3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:52.073571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-24f69e1b-6f97-4d4c-9e5a-f04a42f1f831 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:52.081474 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-cae99ed9-57db-43ad-994c-2600a44b21a3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.451144 Dec 23 11:59:52.082052 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 99/206] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:51 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:59:52.082757 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-24f69e1b-6f97-4d4c-9e5a-f04a42f1f831 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.585317 Dec 23 11:59:52.087456 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-7bd03e77-7bf4-4c4e-9a71-a3dbfb79d6ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:52.088383 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-7bd03e77-7bf4-4c4e-9a71-a3dbfb79d6ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:52.091159 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 108/207] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:51 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:52.094650 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7bd03e77-7bf4-4c4e-9a71-a3dbfb79d6ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:52.095075 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7bd03e77-7bf4-4c4e-9a71-a3dbfb79d6ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:52.095859 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7bd03e77-7bf4-4c4e-9a71-a3dbfb79d6ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:52.096508 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7bd03e77-7bf4-4c4e-9a71-a3dbfb79d6ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:52.243591 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-7bd03e77-7bf4-4c4e-9a71-a3dbfb79d6ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 17602 microversion: 2.20 time: 0.159619 Dec 23 11:59:52.244236 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 100/208] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:52 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 17602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 11:59:53.098535 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-68d7c317-6b1f-439b-ba57-76eb17675df5 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:53.099224 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-68d7c317-6b1f-439b-ba57-76eb17675df5 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:53.100950 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-246c3aba-4581-4f8f-b834-103fe4df2050 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:53.102116 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-246c3aba-4581-4f8f-b834-103fe4df2050 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:53.107805 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-68d7c317-6b1f-439b-ba57-76eb17675df5 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:53.108726 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-68d7c317-6b1f-439b-ba57-76eb17675df5 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:53.109831 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-246c3aba-4581-4f8f-b834-103fe4df2050 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:53.109959 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-68d7c317-6b1f-439b-ba57-76eb17675df5 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:53.110549 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-68d7c317-6b1f-439b-ba57-76eb17675df5 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:53.110705 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-246c3aba-4581-4f8f-b834-103fe4df2050 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:53.111962 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-246c3aba-4581-4f8f-b834-103fe4df2050 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:53.112555 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-246c3aba-4581-4f8f-b834-103fe4df2050 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:53.338387 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-246c3aba-4581-4f8f-b834-103fe4df2050 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:53.345485 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-68d7c317-6b1f-439b-ba57-76eb17675df5 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:53.346915 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-246c3aba-4581-4f8f-b834-103fe4df2050 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.250693 Dec 23 11:59:53.358710 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 101/209] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:53 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:53.362671 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-68d7c317-6b1f-439b-ba57-76eb17675df5 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1313 microversion: 2.1 time: 0.269074 Dec 23 11:59:53.363243 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 109/210] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:53 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:53.370672 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-44a3d7b4-a5b9-4ee1-85bc-2d348bbc61be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:53.370672 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-44a3d7b4-a5b9-4ee1-85bc-2d348bbc61be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:53.376881 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-44a3d7b4-a5b9-4ee1-85bc-2d348bbc61be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:53.377450 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-44a3d7b4-a5b9-4ee1-85bc-2d348bbc61be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:53.378384 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-44a3d7b4-a5b9-4ee1-85bc-2d348bbc61be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:53.378921 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-44a3d7b4-a5b9-4ee1-85bc-2d348bbc61be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:53.529163 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-44a3d7b4-a5b9-4ee1-85bc-2d348bbc61be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 17602 microversion: 2.20 time: 0.168243 Dec 23 11:59:53.529875 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 102/211] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:53 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 17602 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 11:59:54.365056 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7d18902e-e536-4d0e-b9d9-326fc3b3e1f1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:54.366255 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-7d18902e-e536-4d0e-b9d9-326fc3b3e1f1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:54.381547 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-94f29237-759b-4156-93e3-1d7b7233aed5 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:54.382309 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-94f29237-759b-4156-93e3-1d7b7233aed5 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:54.386840 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7d18902e-e536-4d0e-b9d9-326fc3b3e1f1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:54.387263 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7d18902e-e536-4d0e-b9d9-326fc3b3e1f1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:54.388071 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7d18902e-e536-4d0e-b9d9-326fc3b3e1f1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:54.390552 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7d18902e-e536-4d0e-b9d9-326fc3b3e1f1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:54.395366 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-94f29237-759b-4156-93e3-1d7b7233aed5 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:54.395815 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-94f29237-759b-4156-93e3-1d7b7233aed5 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:54.396601 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-94f29237-759b-4156-93e3-1d7b7233aed5 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:54.397030 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-94f29237-759b-4156-93e3-1d7b7233aed5 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:54.601837 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-94f29237-759b-4156-93e3-1d7b7233aed5 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:54.621401 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-94f29237-759b-4156-93e3-1d7b7233aed5 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1497 microversion: 2.1 time: 0.241359 Dec 23 11:59:54.633489 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 103/212] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:54 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1497 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:59:54.633772 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-7d18902e-e536-4d0e-b9d9-326fc3b3e1f1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:54.633894 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-84075494-822d-421c-a8fb-8b17c17a3c94 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:54.633894 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-84075494-822d-421c-a8fb-8b17c17a3c94 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:54.636422 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-7d18902e-e536-4d0e-b9d9-326fc3b3e1f1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.275308 Dec 23 11:59:54.636992 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 110/213] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:54 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:54.641286 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-84075494-822d-421c-a8fb-8b17c17a3c94 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:54.641661 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-84075494-822d-421c-a8fb-8b17c17a3c94 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:54.642450 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-84075494-822d-421c-a8fb-8b17c17a3c94 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:54.644252 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-84075494-822d-421c-a8fb-8b17c17a3c94 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:54.794762 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-84075494-822d-421c-a8fb-8b17c17a3c94 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 19342 microversion: 2.20 time: 0.170002 Dec 23 11:59:54.795464 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 104/214] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:54 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 19342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 11:59:55.470068 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-301cd18b-6037-42d5-93be-fcc5e415a605 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:55.470685 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-301cd18b-6037-42d5-93be-fcc5e415a605 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:55.476903 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-301cd18b-6037-42d5-93be-fcc5e415a605 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:55.477207 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-301cd18b-6037-42d5-93be-fcc5e415a605 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:55.477993 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-301cd18b-6037-42d5-93be-fcc5e415a605 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:55.478408 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-301cd18b-6037-42d5-93be-fcc5e415a605 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:55.503839 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-301cd18b-6037-42d5-93be-fcc5e415a605 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Going to try to terminate instance {{(pid=116354) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 11:59:55.588250 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-301cd18b-6037-42d5-93be-fcc5e415a605 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 204 len: 0 microversion: 2.1 time: 0.121849 Dec 23 11:59:55.589040 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 111/215] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 11:59:55 2021] DELETE /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 11:59:55.598948 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-acb6f947-2ade-4227-9133-c85f0a8f569b tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:55.599695 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-acb6f947-2ade-4227-9133-c85f0a8f569b tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:55.609254 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-acb6f947-2ade-4227-9133-c85f0a8f569b tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:55.609910 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-acb6f947-2ade-4227-9133-c85f0a8f569b tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:55.610989 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-acb6f947-2ade-4227-9133-c85f0a8f569b tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:55.611822 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-acb6f947-2ade-4227-9133-c85f0a8f569b tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:55.653924 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f1427a12-0d46-4987-b864-5632a55e656c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:55.654957 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f1427a12-0d46-4987-b864-5632a55e656c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:55.661211 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f1427a12-0d46-4987-b864-5632a55e656c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:55.661666 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f1427a12-0d46-4987-b864-5632a55e656c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:55.662449 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f1427a12-0d46-4987-b864-5632a55e656c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:55.662907 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f1427a12-0d46-4987-b864-5632a55e656c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:55.787099 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-acb6f947-2ade-4227-9133-c85f0a8f569b tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:55.794771 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-acb6f947-2ade-4227-9133-c85f0a8f569b tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1503 microversion: 2.1 time: 0.201295 Dec 23 11:59:55.795494 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 105/216] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:55 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1503 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:55.809763 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ae4662dd-f085-4ace-b89c-9f483b93127a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:55.811137 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ae4662dd-f085-4ace-b89c-9f483b93127a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:55.817881 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ae4662dd-f085-4ace-b89c-9f483b93127a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:55.818366 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ae4662dd-f085-4ace-b89c-9f483b93127a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:55.819292 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ae4662dd-f085-4ace-b89c-9f483b93127a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:55.819846 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ae4662dd-f085-4ace-b89c-9f483b93127a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:55.843729 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f1427a12-0d46-4987-b864-5632a55e656c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:55.852428 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f1427a12-0d46-4987-b864-5632a55e656c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.202432 Dec 23 11:59:55.853125 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 112/217] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:55 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:55.996392 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ae4662dd-f085-4ace-b89c-9f483b93127a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 21344 microversion: 2.20 time: 0.192492 Dec 23 11:59:55.997155 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 106/218] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:55 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 21344 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 11:59:56.814014 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c1600c53-a8bf-4780-8f27-d06e6ea20ddd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:56.814647 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c1600c53-a8bf-4780-8f27-d06e6ea20ddd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:56.821175 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c1600c53-a8bf-4780-8f27-d06e6ea20ddd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:56.821704 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c1600c53-a8bf-4780-8f27-d06e6ea20ddd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:56.822592 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c1600c53-a8bf-4780-8f27-d06e6ea20ddd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:56.823085 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c1600c53-a8bf-4780-8f27-d06e6ea20ddd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:56.871092 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-6c0394ee-bc02-4a67-ad6b-2cbe2a10b14c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:56.871900 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-6c0394ee-bc02-4a67-ad6b-2cbe2a10b14c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:56.879123 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6c0394ee-bc02-4a67-ad6b-2cbe2a10b14c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:56.879574 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6c0394ee-bc02-4a67-ad6b-2cbe2a10b14c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:56.880359 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6c0394ee-bc02-4a67-ad6b-2cbe2a10b14c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:56.880797 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6c0394ee-bc02-4a67-ad6b-2cbe2a10b14c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:56.989791 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c1600c53-a8bf-4780-8f27-d06e6ea20ddd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:56.997450 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c1600c53-a8bf-4780-8f27-d06e6ea20ddd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1503 microversion: 2.1 time: 0.187547 Dec 23 11:59:56.998019 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 113/219] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:56 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:57.007478 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f94450e2-10da-4403-90dd-a8891a47a757 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:57.008539 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f94450e2-10da-4403-90dd-a8891a47a757 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:57.016174 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f94450e2-10da-4403-90dd-a8891a47a757 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:57.016624 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f94450e2-10da-4403-90dd-a8891a47a757 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:57.017408 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f94450e2-10da-4403-90dd-a8891a47a757 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:57.017848 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f94450e2-10da-4403-90dd-a8891a47a757 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:57.054216 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-6c0394ee-bc02-4a67-ad6b-2cbe2a10b14c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:57.061575 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-6c0394ee-bc02-4a67-ad6b-2cbe2a10b14c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.194771 Dec 23 11:59:57.062162 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 107/220] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:56 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:57.170162 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f94450e2-10da-4403-90dd-a8891a47a757 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 22494 microversion: 2.20 time: 0.165470 Dec 23 11:59:57.171006 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 114/221] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:57 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 22494 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 23 11:59:58.014608 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e5fbfee1-4eac-4aef-bbec-09329b36a2e2 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:58.015689 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e5fbfee1-4eac-4aef-bbec-09329b36a2e2 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:58.022781 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e5fbfee1-4eac-4aef-bbec-09329b36a2e2 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:58.023224 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e5fbfee1-4eac-4aef-bbec-09329b36a2e2 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:58.024433 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e5fbfee1-4eac-4aef-bbec-09329b36a2e2 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:58.024884 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e5fbfee1-4eac-4aef-bbec-09329b36a2e2 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:58.077697 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0f8e1d73-012c-4f5d-bfdb-3dd43c870836 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:58.079040 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0f8e1d73-012c-4f5d-bfdb-3dd43c870836 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:58.094827 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0f8e1d73-012c-4f5d-bfdb-3dd43c870836 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:58.094827 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0f8e1d73-012c-4f5d-bfdb-3dd43c870836 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:58.094827 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0f8e1d73-012c-4f5d-bfdb-3dd43c870836 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:58.094827 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0f8e1d73-012c-4f5d-bfdb-3dd43c870836 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:58.225816 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e5fbfee1-4eac-4aef-bbec-09329b36a2e2 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:58.235142 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e5fbfee1-4eac-4aef-bbec-09329b36a2e2 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1503 microversion: 2.1 time: 0.224359 Dec 23 11:59:58.235743 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 108/222] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:58 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:58.241715 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c6e263c3-5949-4aae-9dea-061c6ca737ee tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:58.243564 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c6e263c3-5949-4aae-9dea-061c6ca737ee tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:58.252697 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c6e263c3-5949-4aae-9dea-061c6ca737ee tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:58.253327 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c6e263c3-5949-4aae-9dea-061c6ca737ee tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:58.254836 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c6e263c3-5949-4aae-9dea-061c6ca737ee tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:58.255864 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c6e263c3-5949-4aae-9dea-061c6ca737ee tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:58.277991 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0f8e1d73-012c-4f5d-bfdb-3dd43c870836 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:58.286104 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0f8e1d73-012c-4f5d-bfdb-3dd43c870836 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.212310 Dec 23 11:59:58.286909 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 115/223] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:58 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 11:59:58.531440 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c6e263c3-5949-4aae-9dea-061c6ca737ee tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 23225 microversion: 2.20 time: 0.294193 Dec 23 11:59:58.534729 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 109/224] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:58 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 23225 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 11:59:59.253527 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c62df72a-11fa-4c1e-aa67-00ff622ceb17 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:59.254067 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c62df72a-11fa-4c1e-aa67-00ff622ceb17 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:59.260593 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c62df72a-11fa-4c1e-aa67-00ff622ceb17 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:59.261026 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c62df72a-11fa-4c1e-aa67-00ff622ceb17 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:59.261892 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c62df72a-11fa-4c1e-aa67-00ff622ceb17 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:59.262330 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c62df72a-11fa-4c1e-aa67-00ff622ceb17 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:59.305191 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ed01f3ea-d4f9-4651-8bae-3eca5025b2fd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 11:59:59.306009 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ed01f3ea-d4f9-4651-8bae-3eca5025b2fd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:59.313974 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ed01f3ea-d4f9-4651-8bae-3eca5025b2fd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:59.314573 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ed01f3ea-d4f9-4651-8bae-3eca5025b2fd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:59.315389 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ed01f3ea-d4f9-4651-8bae-3eca5025b2fd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:59.315800 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ed01f3ea-d4f9-4651-8bae-3eca5025b2fd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:59.580469 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c62df72a-11fa-4c1e-aa67-00ff622ceb17 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:59.589320 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c62df72a-11fa-4c1e-aa67-00ff622ceb17 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 200 len: 1503 microversion: 2.1 time: 0.339603 Dec 23 11:59:59.589983 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 116/225] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:59 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 1503 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:59.595041 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-acada456-283a-4472-b24f-48046624329b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:59.596046 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-acada456-283a-4472-b24f-48046624329b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 11:59:59.602336 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-acada456-283a-4472-b24f-48046624329b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:59.603148 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-acada456-283a-4472-b24f-48046624329b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:59.604210 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-acada456-283a-4472-b24f-48046624329b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:59.605252 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-acada456-283a-4472-b24f-48046624329b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:59.619664 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ed01f3ea-d4f9-4651-8bae-3eca5025b2fd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 11:59:59.630080 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ed01f3ea-d4f9-4651-8bae-3eca5025b2fd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.328885 Dec 23 11:59:59.630978 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 110/226] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 11:59:59 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 11:59:59.637009 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-bf605de2-640c-4ef1-a428-cad6d6099dea req-4630fed4-08e0-4da6-89ae-47c279a139ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ae9f51-c8c9-4ae9-bc69-3a953763e90d", "name": "network-vif-deleted", "tag": "a1ba6b3d-eecc-454c-b417-768470bc0893"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 11:59:59.638765 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:59:59.638765 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 11:59:59.645799 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-bf605de2-640c-4ef1-a428-cad6d6099dea req-4630fed4-08e0-4da6-89ae-47c279a139ac service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 11:59:59.646290 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-bf605de2-640c-4ef1-a428-cad6d6099dea req-4630fed4-08e0-4da6-89ae-47c279a139ac service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 11:59:59.657248 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-bf605de2-640c-4ef1-a428-cad6d6099dea req-4630fed4-08e0-4da6-89ae-47c279a139ac service nova] Creating event network-vif-deleted:a1ba6b3d-eecc-454c-b417-768470bc0893 for instance f0ae9f51-c8c9-4ae9-bc69-3a953763e90d on hv-cinder-82282 Dec 23 11:59:59.661819 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-bf605de2-640c-4ef1-a428-cad6d6099dea req-4630fed4-08e0-4da6-89ae-47c279a139ac service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028341 Dec 23 11:59:59.662411 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 111/227] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 11:59:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 11:59:59.768401 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-acada456-283a-4472-b24f-48046624329b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 24102 microversion: 2.20 time: 0.176757 Dec 23 11:59:59.769015 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 117/228] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 11:59:59 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 24102 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:00.608658 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a5566da7-0085-4277-8f77-0a344aa84d73 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:00.609590 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a5566da7-0085-4277-8f77-0a344aa84d73 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: f0ae9f51-c8c9-4ae9-bc69-3a953763e90d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:00.617232 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a5566da7-0085-4277-8f77-0a344aa84d73 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:00.617692 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a5566da7-0085-4277-8f77-0a344aa84d73 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:00.618750 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a5566da7-0085-4277-8f77-0a344aa84d73 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:00.619520 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a5566da7-0085-4277-8f77-0a344aa84d73 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:00.642794 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-a5566da7-0085-4277-8f77-0a344aa84d73 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] HTTP exception thrown: Instance f0ae9f51-c8c9-4ae9-bc69-3a953763e90d could not be found. Dec 23 12:00:00.643578 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a5566da7-0085-4277-8f77-0a344aa84d73 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Returning 404 to user: Instance f0ae9f51-c8c9-4ae9-bc69-3a953763e90d could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:00:00.644503 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a5566da7-0085-4277-8f77-0a344aa84d73 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d" status: 404 len: 111 microversion: 2.1 time: 0.041618 Dec 23 12:00:00.645295 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 112/229] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:00 2021] GET /compute/v2.1/servers/f0ae9f51-c8c9-4ae9-bc69-3a953763e90d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:00:00.648328 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-56f0ddcc-fd7a-4d09-b73c-4348eb01d52d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:00.649642 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-56f0ddcc-fd7a-4d09-b73c-4348eb01d52d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:00.658577 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-56f0ddcc-fd7a-4d09-b73c-4348eb01d52d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:00.659055 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-56f0ddcc-fd7a-4d09-b73c-4348eb01d52d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:00.660301 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-56f0ddcc-fd7a-4d09-b73c-4348eb01d52d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:00.660739 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-56f0ddcc-fd7a-4d09-b73c-4348eb01d52d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:00.754713 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-6255041a-450e-4847-991f-d885e369d5fb tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1447110596", "imageRef": "938a78c0-341e-4043-927a-9bfe8cf52508", "flavorRef": "452", "networks": [{"uuid": "c19c572b-1b5e-4a3c-96b3-4936188f29bd"}]}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:00.813392 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-56f0ddcc-fd7a-4d09-b73c-4348eb01d52d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:00.822247 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-56f0ddcc-fd7a-4d09-b73c-4348eb01d52d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.178257 Dec 23 12:00:00.823187 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 118/230] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:00 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:00:00.828378 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4ff6ac16-3973-4d20-83b0-8770c2ecfb48 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:00.829567 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4ff6ac16-3973-4d20-83b0-8770c2ecfb48 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:00.840751 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4ff6ac16-3973-4d20-83b0-8770c2ecfb48 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:00.841214 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4ff6ac16-3973-4d20-83b0-8770c2ecfb48 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:00.842106 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4ff6ac16-3973-4d20-83b0-8770c2ecfb48 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:00.842753 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4ff6ac16-3973-4d20-83b0-8770c2ecfb48 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:00.986644 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4ff6ac16-3973-4d20-83b0-8770c2ecfb48 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 24780 microversion: 2.20 time: 0.161279 Dec 23 12:00:00.987577 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 119/231] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:00 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 24780 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:01.841382 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-37ffac30-8791-45c7-b285-a6d6bfe7d684 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:01.842102 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-37ffac30-8791-45c7-b285-a6d6bfe7d684 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:01.849153 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-37ffac30-8791-45c7-b285-a6d6bfe7d684 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:01.849604 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-37ffac30-8791-45c7-b285-a6d6bfe7d684 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:01.850398 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-37ffac30-8791-45c7-b285-a6d6bfe7d684 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:01.850879 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-37ffac30-8791-45c7-b285-a6d6bfe7d684 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:01.995113 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-37ffac30-8791-45c7-b285-a6d6bfe7d684 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:02.003255 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-37ffac30-8791-45c7-b285-a6d6bfe7d684 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.165890 Dec 23 12:00:02.003825 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 120/232] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:01 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:02.008338 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2bc4b976-11d1-42fe-b5e1-6826c1822e72 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:02.009381 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2bc4b976-11d1-42fe-b5e1-6826c1822e72 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:02.015300 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2bc4b976-11d1-42fe-b5e1-6826c1822e72 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:02.015764 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2bc4b976-11d1-42fe-b5e1-6826c1822e72 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:02.016546 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2bc4b976-11d1-42fe-b5e1-6826c1822e72 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:02.016983 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2bc4b976-11d1-42fe-b5e1-6826c1822e72 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:02.158055 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2bc4b976-11d1-42fe-b5e1-6826c1822e72 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 25545 microversion: 2.20 time: 0.152878 Dec 23 12:00:02.161825 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 121/233] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:02 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 25545 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:03.031366 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-48681219-c737-4d37-b96f-9ed4363388e4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:03.039000 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-48681219-c737-4d37-b96f-9ed4363388e4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:03.046860 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-48681219-c737-4d37-b96f-9ed4363388e4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:03.047410 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-48681219-c737-4d37-b96f-9ed4363388e4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:03.048253 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-48681219-c737-4d37-b96f-9ed4363388e4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:03.048699 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-48681219-c737-4d37-b96f-9ed4363388e4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:03.195839 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-48681219-c737-4d37-b96f-9ed4363388e4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:03.204890 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-48681219-c737-4d37-b96f-9ed4363388e4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.183773 Dec 23 12:00:03.204890 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 122/234] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:03 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:03.215961 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8afbdad6-e0d7-4ef8-8e5a-16e28f9e55ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:03.216937 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8afbdad6-e0d7-4ef8-8e5a-16e28f9e55ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:03.224795 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8afbdad6-e0d7-4ef8-8e5a-16e28f9e55ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:03.225254 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8afbdad6-e0d7-4ef8-8e5a-16e28f9e55ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:03.226047 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8afbdad6-e0d7-4ef8-8e5a-16e28f9e55ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:03.226728 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8afbdad6-e0d7-4ef8-8e5a-16e28f9e55ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:03.370977 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8afbdad6-e0d7-4ef8-8e5a-16e28f9e55ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 26325 microversion: 2.20 time: 0.164548 Dec 23 12:00:03.371893 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 123/235] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:03 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 26325 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:04.223398 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1b148e87-5b32-41d2-8412-e0045e20bdfe tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:04.224099 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1b148e87-5b32-41d2-8412-e0045e20bdfe tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:04.232947 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1b148e87-5b32-41d2-8412-e0045e20bdfe tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:04.233637 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1b148e87-5b32-41d2-8412-e0045e20bdfe tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:04.234579 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1b148e87-5b32-41d2-8412-e0045e20bdfe tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:04.235198 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1b148e87-5b32-41d2-8412-e0045e20bdfe tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:04.412367 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1b148e87-5b32-41d2-8412-e0045e20bdfe tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:04.420800 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1b148e87-5b32-41d2-8412-e0045e20bdfe tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.203099 Dec 23 12:00:04.421683 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 124/236] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:04 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:04.429709 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-562b2c25-ee6e-490c-9ba1-58ea48700de2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:04.431142 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-562b2c25-ee6e-490c-9ba1-58ea48700de2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:04.437960 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-562b2c25-ee6e-490c-9ba1-58ea48700de2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:04.438553 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-562b2c25-ee6e-490c-9ba1-58ea48700de2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:04.439588 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-562b2c25-ee6e-490c-9ba1-58ea48700de2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:04.439935 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-562b2c25-ee6e-490c-9ba1-58ea48700de2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:04.593733 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-562b2c25-ee6e-490c-9ba1-58ea48700de2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 27001 microversion: 2.20 time: 0.168068 Dec 23 12:00:04.594412 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 125/237] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:04 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 27001 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:05.442398 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-33208995-bf47-4b32-a1b2-e3a0dfa4ba4d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:05.443466 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-33208995-bf47-4b32-a1b2-e3a0dfa4ba4d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:05.450569 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-33208995-bf47-4b32-a1b2-e3a0dfa4ba4d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:05.451131 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-33208995-bf47-4b32-a1b2-e3a0dfa4ba4d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:05.452003 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-33208995-bf47-4b32-a1b2-e3a0dfa4ba4d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:05.452516 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-33208995-bf47-4b32-a1b2-e3a0dfa4ba4d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:05.631245 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-33208995-bf47-4b32-a1b2-e3a0dfa4ba4d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:05.640206 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-33208995-bf47-4b32-a1b2-e3a0dfa4ba4d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.202351 Dec 23 12:00:05.640719 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 126/238] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:05 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:05.647818 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1bf47008-2487-40fa-a0ef-ad31c16f50d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:05.648816 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1bf47008-2487-40fa-a0ef-ad31c16f50d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:05.660112 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1bf47008-2487-40fa-a0ef-ad31c16f50d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:05.660564 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1bf47008-2487-40fa-a0ef-ad31c16f50d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:05.661364 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1bf47008-2487-40fa-a0ef-ad31c16f50d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:05.661797 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1bf47008-2487-40fa-a0ef-ad31c16f50d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:05.821892 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1bf47008-2487-40fa-a0ef-ad31c16f50d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 27321 microversion: 2.20 time: 0.179697 Dec 23 12:00:05.822604 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 127/239] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:05 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 27321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:06.659987 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0c182533-eb3f-4d83-be7e-02df237560b3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:06.661569 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0c182533-eb3f-4d83-be7e-02df237560b3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:06.669279 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0c182533-eb3f-4d83-be7e-02df237560b3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:06.669805 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0c182533-eb3f-4d83-be7e-02df237560b3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:06.670713 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0c182533-eb3f-4d83-be7e-02df237560b3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:06.671155 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0c182533-eb3f-4d83-be7e-02df237560b3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:06.912186 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0c182533-eb3f-4d83-be7e-02df237560b3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:06.924245 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0c182533-eb3f-4d83-be7e-02df237560b3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.267556 Dec 23 12:00:06.934325 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 128/240] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:06 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:06.934325 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-de13f5e9-bd91-469e-9df8-6ccd50f97391 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:06.934325 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-de13f5e9-bd91-469e-9df8-6ccd50f97391 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:06.939867 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-de13f5e9-bd91-469e-9df8-6ccd50f97391 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:06.940572 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-de13f5e9-bd91-469e-9df8-6ccd50f97391 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:06.941763 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-de13f5e9-bd91-469e-9df8-6ccd50f97391 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:06.942466 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-de13f5e9-bd91-469e-9df8-6ccd50f97391 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:07.100416 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-de13f5e9-bd91-469e-9df8-6ccd50f97391 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 27562 microversion: 2.20 time: 0.173913 Dec 23 12:00:07.100961 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 129/241] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:06 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 27562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:07.942332 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c469f27d-c5d0-4e3c-83a8-28d1f0f1410f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:07.943065 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c469f27d-c5d0-4e3c-83a8-28d1f0f1410f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:07.950187 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c469f27d-c5d0-4e3c-83a8-28d1f0f1410f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:07.950737 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c469f27d-c5d0-4e3c-83a8-28d1f0f1410f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:07.951523 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c469f27d-c5d0-4e3c-83a8-28d1f0f1410f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:07.951965 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c469f27d-c5d0-4e3c-83a8-28d1f0f1410f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:08.095160 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c469f27d-c5d0-4e3c-83a8-28d1f0f1410f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:08.102577 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c469f27d-c5d0-4e3c-83a8-28d1f0f1410f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.164443 Dec 23 12:00:08.103166 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 130/242] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:07 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:08.112356 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0391eabf-8cca-4f9a-a817-412bd13baca6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:08.113232 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0391eabf-8cca-4f9a-a817-412bd13baca6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:08.119629 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0391eabf-8cca-4f9a-a817-412bd13baca6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:08.120074 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0391eabf-8cca-4f9a-a817-412bd13baca6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:08.120847 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0391eabf-8cca-4f9a-a817-412bd13baca6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:08.121276 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0391eabf-8cca-4f9a-a817-412bd13baca6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:08.271216 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0391eabf-8cca-4f9a-a817-412bd13baca6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 27747 microversion: 2.20 time: 0.162047 Dec 23 12:00:08.272083 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 131/243] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:08 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 27747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:09.121156 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-21a13361-2d27-462d-904b-d97310f1f11b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:09.122125 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-21a13361-2d27-462d-904b-d97310f1f11b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:09.129933 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-21a13361-2d27-462d-904b-d97310f1f11b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:09.130390 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-21a13361-2d27-462d-904b-d97310f1f11b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:09.131319 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-21a13361-2d27-462d-904b-d97310f1f11b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:09.131765 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-21a13361-2d27-462d-904b-d97310f1f11b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:09.271413 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-21a13361-2d27-462d-904b-d97310f1f11b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:09.279166 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-21a13361-2d27-462d-904b-d97310f1f11b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.162315 Dec 23 12:00:09.279728 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 132/244] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:09 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:09.285473 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-76d60509-3e2a-4cb3-87eb-3e169bfa6960 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:09.286393 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-76d60509-3e2a-4cb3-87eb-3e169bfa6960 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:09.292169 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-76d60509-3e2a-4cb3-87eb-3e169bfa6960 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:09.292590 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-76d60509-3e2a-4cb3-87eb-3e169bfa6960 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:09.293367 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-76d60509-3e2a-4cb3-87eb-3e169bfa6960 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:09.293800 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-76d60509-3e2a-4cb3-87eb-3e169bfa6960 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:09.422134 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-76d60509-3e2a-4cb3-87eb-3e169bfa6960 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 28167 microversion: 2.20 time: 0.140453 Dec 23 12:00:09.422814 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 133/245] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:09 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 28167 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:10.299447 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d84bde08-70dc-4116-90c2-880fdfdd7d83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:10.300285 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d84bde08-70dc-4116-90c2-880fdfdd7d83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:10.307856 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d84bde08-70dc-4116-90c2-880fdfdd7d83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:10.308578 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d84bde08-70dc-4116-90c2-880fdfdd7d83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:10.309459 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d84bde08-70dc-4116-90c2-880fdfdd7d83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:10.310086 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d84bde08-70dc-4116-90c2-880fdfdd7d83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:10.342740 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.network.neutron [None req-6255041a-450e-4847-991f-d885e369d5fb tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] validate_networks() for [('c19c572b-1b5e-4a3c-96b3-4936188f29bd', None, None, None, None, None)] {{(pid=116355) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 12:00:10.541582 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-d84bde08-70dc-4116-90c2-880fdfdd7d83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:10.549380 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d84bde08-70dc-4116-90c2-880fdfdd7d83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.255989 Dec 23 12:00:10.549945 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 134/246] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:10 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:10.554299 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-94d5ecea-e645-413f-8124-0d2f6da5b3b9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:10.555678 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-94d5ecea-e645-413f-8124-0d2f6da5b3b9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:10.561626 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-94d5ecea-e645-413f-8124-0d2f6da5b3b9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:10.562070 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-94d5ecea-e645-413f-8124-0d2f6da5b3b9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:10.562887 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-94d5ecea-e645-413f-8124-0d2f6da5b3b9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:10.563317 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-94d5ecea-e645-413f-8124-0d2f6da5b3b9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:10.693932 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-94d5ecea-e645-413f-8124-0d2f6da5b3b9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 28167 microversion: 2.20 time: 0.142685 Dec 23 12:00:10.697889 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 135/247] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:10 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 28167 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:10.760627 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-6255041a-450e-4847-991f-d885e369d5fb tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Flavor limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 12:00:10.761036 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-6255041a-450e-4847-991f-d885e369d5fb tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Image limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 12:00:10.761526 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-6255041a-450e-4847-991f-d885e369d5fb tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Flavor pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 12:00:10.761919 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-6255041a-450e-4847-991f-d885e369d5fb tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Image pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 12:00:10.762316 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-6255041a-450e-4847-991f-d885e369d5fb tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 12:00:10.770940 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6255041a-450e-4847-991f-d885e369d5fb tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:10.771393 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6255041a-450e-4847-991f-d885e369d5fb tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:10.772171 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6255041a-450e-4847-991f-d885e369d5fb tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:10.772595 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6255041a-450e-4847-991f-d885e369d5fb tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:10.790281 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-6255041a-450e-4847-991f-d885e369d5fb tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Getting quotas for project 7ca5ca45c6494bff9a1a66863948f839. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:00:10.794988 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-6255041a-450e-4847-991f-d885e369d5fb tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Getting quotas for user b9397ca2bd8a4195a2c54dbb1a97ddf0 and project 7ca5ca45c6494bff9a1a66863948f839. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:00:10.807190 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-6255041a-450e-4847-991f-d885e369d5fb tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Going to run 1 instances... {{(pid=116355) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 12:00:10.809616 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-6255041a-450e-4847-991f-d885e369d5fb tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='938a78c0-341e-4043-927a-9bfe8cf52508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 12:00:10.855415 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-6255041a-450e-4847-991f-d885e369d5fb tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.104302 Dec 23 12:00:10.856063 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 113/248] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 12:00:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 10106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 23 12:00:10.867027 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b5c9b743-3540-4089-9522-c0b8843a52f3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:10.867762 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b5c9b743-3540-4089-9522-c0b8843a52f3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:10.920891 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-b5c9b743-3540-4089-9522-c0b8843a52f3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:10.928928 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b5c9b743-3540-4089-9522-c0b8843a52f3 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1214 microversion: 2.1 time: 0.066104 Dec 23 12:00:10.929601 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 136/249] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:10 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:11.566280 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-6dcdb624-a59a-4f40-8d8e-9533a5533e4e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:11.566933 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-6dcdb624-a59a-4f40-8d8e-9533a5533e4e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:11.573222 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6dcdb624-a59a-4f40-8d8e-9533a5533e4e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:11.573671 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6dcdb624-a59a-4f40-8d8e-9533a5533e4e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:11.575034 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6dcdb624-a59a-4f40-8d8e-9533a5533e4e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:11.575496 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6dcdb624-a59a-4f40-8d8e-9533a5533e4e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:11.705685 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-506deefe-7821-4289-87ac-f45e0fa58eb7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:11.707135 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-506deefe-7821-4289-87ac-f45e0fa58eb7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:11.711288 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-6dcdb624-a59a-4f40-8d8e-9533a5533e4e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:11.714953 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-506deefe-7821-4289-87ac-f45e0fa58eb7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:11.715412 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-506deefe-7821-4289-87ac-f45e0fa58eb7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:11.716226 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-506deefe-7821-4289-87ac-f45e0fa58eb7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:11.716666 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-506deefe-7821-4289-87ac-f45e0fa58eb7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:11.720029 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-6dcdb624-a59a-4f40-8d8e-9533a5533e4e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.157942 Dec 23 12:00:11.730385 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 114/250] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:11 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:11.853046 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-506deefe-7821-4289-87ac-f45e0fa58eb7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 28167 microversion: 2.20 time: 0.151339 Dec 23 12:00:11.853711 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 137/251] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:11 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 28167 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:11.949762 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b2035c26-1e52-44f4-aa44-458cfb866617 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:11.950848 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b2035c26-1e52-44f4-aa44-458cfb866617 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:11.959477 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b2035c26-1e52-44f4-aa44-458cfb866617 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:11.959928 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b2035c26-1e52-44f4-aa44-458cfb866617 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:11.960699 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b2035c26-1e52-44f4-aa44-458cfb866617 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:11.961128 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b2035c26-1e52-44f4-aa44-458cfb866617 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:12.019111 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b2035c26-1e52-44f4-aa44-458cfb866617 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:12.026445 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b2035c26-1e52-44f4-aa44-458cfb866617 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1266 microversion: 2.1 time: 0.082829 Dec 23 12:00:12.027038 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 115/252] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:11 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:12.738095 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f3232d10-c1ea-427f-9424-47041068d79c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:12.738944 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f3232d10-c1ea-427f-9424-47041068d79c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:12.745920 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f3232d10-c1ea-427f-9424-47041068d79c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:12.746363 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f3232d10-c1ea-427f-9424-47041068d79c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:12.747157 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f3232d10-c1ea-427f-9424-47041068d79c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:12.747613 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f3232d10-c1ea-427f-9424-47041068d79c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:12.865547 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e14fd72d-7f2f-42d8-a221-f6991d53d16d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:12.867171 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e14fd72d-7f2f-42d8-a221-f6991d53d16d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:12.874498 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e14fd72d-7f2f-42d8-a221-f6991d53d16d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:12.875211 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e14fd72d-7f2f-42d8-a221-f6991d53d16d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:12.876201 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e14fd72d-7f2f-42d8-a221-f6991d53d16d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:12.876834 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e14fd72d-7f2f-42d8-a221-f6991d53d16d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:12.975919 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f3232d10-c1ea-427f-9424-47041068d79c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:12.984397 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f3232d10-c1ea-427f-9424-47041068d79c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.250911 Dec 23 12:00:12.984893 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 138/253] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:12 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:13.010804 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e14fd72d-7f2f-42d8-a221-f6991d53d16d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 28182 microversion: 2.20 time: 0.149518 Dec 23 12:00:13.026590 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 116/254] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:12 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 28182 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:13.044507 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-12db8a4c-7bd6-4e49-984e-229da2bc2c18 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:13.045307 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-12db8a4c-7bd6-4e49-984e-229da2bc2c18 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:13.053884 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-12db8a4c-7bd6-4e49-984e-229da2bc2c18 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:13.054305 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-12db8a4c-7bd6-4e49-984e-229da2bc2c18 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:13.055294 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-12db8a4c-7bd6-4e49-984e-229da2bc2c18 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:13.055916 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-12db8a4c-7bd6-4e49-984e-229da2bc2c18 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:13.263521 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-12db8a4c-7bd6-4e49-984e-229da2bc2c18 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:13.264189 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-12db8a4c-7bd6-4e49-984e-229da2bc2c18 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1314 microversion: 2.1 time: 0.224510 Dec 23 12:00:13.264781 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 139/255] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:13 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:00:13.942385 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-63a9221b-e268-4382-b485-32fe35fbc319 req-a56cddf8-35af-4e2e-b74f-f87b73773475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7549231-99ea-452a-abd4-cfd75b597880", "tag": "a50bdab5-72fe-4fc4-9208-6cb238170521"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:13.944429 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:00:13.944429 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:00:13.952711 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-63a9221b-e268-4382-b485-32fe35fbc319 req-a56cddf8-35af-4e2e-b74f-f87b73773475 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:13.953330 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-63a9221b-e268-4382-b485-32fe35fbc319 req-a56cddf8-35af-4e2e-b74f-f87b73773475 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:13.967222 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-63a9221b-e268-4382-b485-32fe35fbc319 req-a56cddf8-35af-4e2e-b74f-f87b73773475 service nova] Creating event network-changed:a50bdab5-72fe-4fc4-9208-6cb238170521 for instance b7549231-99ea-452a-abd4-cfd75b597880 on hv-cinder-82282 Dec 23 12:00:13.972158 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-63a9221b-e268-4382-b485-32fe35fbc319 req-a56cddf8-35af-4e2e-b74f-f87b73773475 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034010 Dec 23 12:00:13.972898 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 117/256] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:00:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:00:14.003473 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-569f7c45-cabd-45fa-8f15-c6d209f2a706 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:14.004233 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-569f7c45-cabd-45fa-8f15-c6d209f2a706 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:14.010705 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-569f7c45-cabd-45fa-8f15-c6d209f2a706 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:14.011166 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-569f7c45-cabd-45fa-8f15-c6d209f2a706 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:14.011959 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-569f7c45-cabd-45fa-8f15-c6d209f2a706 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:14.012396 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-569f7c45-cabd-45fa-8f15-c6d209f2a706 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:14.022988 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-56b8208c-7a68-4155-894e-8ab7c8a2407e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:14.023991 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-56b8208c-7a68-4155-894e-8ab7c8a2407e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:14.030601 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-56b8208c-7a68-4155-894e-8ab7c8a2407e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:14.031062 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-56b8208c-7a68-4155-894e-8ab7c8a2407e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:14.031851 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-56b8208c-7a68-4155-894e-8ab7c8a2407e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:14.032285 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-56b8208c-7a68-4155-894e-8ab7c8a2407e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:14.175523 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-569f7c45-cabd-45fa-8f15-c6d209f2a706 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:14.181735 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-56b8208c-7a68-4155-894e-8ab7c8a2407e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 28457 microversion: 2.20 time: 0.163115 Dec 23 12:00:14.183169 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-569f7c45-cabd-45fa-8f15-c6d209f2a706 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.183929 Dec 23 12:00:14.183734 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 140/257] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:13 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:14.186243 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 118/258] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:14 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 28457 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 23 12:00:14.280637 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-01bf6f44-f18d-4621-8a76-140749b803d8 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:14.281237 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-01bf6f44-f18d-4621-8a76-140749b803d8 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:14.287447 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-01bf6f44-f18d-4621-8a76-140749b803d8 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:14.288082 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-01bf6f44-f18d-4621-8a76-140749b803d8 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:14.288874 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-01bf6f44-f18d-4621-8a76-140749b803d8 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:14.289308 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-01bf6f44-f18d-4621-8a76-140749b803d8 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:14.513489 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-01bf6f44-f18d-4621-8a76-140749b803d8 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:14.522326 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-01bf6f44-f18d-4621-8a76-140749b803d8 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1314 microversion: 2.1 time: 0.245258 Dec 23 12:00:14.522925 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 141/259] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:14 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:15.195535 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-602e8131-7fd1-4947-bf00-297f6e22c985 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:15.196560 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-602e8131-7fd1-4947-bf00-297f6e22c985 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:15.199722 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f5a87400-dbd6-45a5-9fd4-4157c4246b98 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:15.200922 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f5a87400-dbd6-45a5-9fd4-4157c4246b98 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:15.204149 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-602e8131-7fd1-4947-bf00-297f6e22c985 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:15.204604 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-602e8131-7fd1-4947-bf00-297f6e22c985 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:15.205363 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-602e8131-7fd1-4947-bf00-297f6e22c985 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:15.205973 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-602e8131-7fd1-4947-bf00-297f6e22c985 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:15.207098 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f5a87400-dbd6-45a5-9fd4-4157c4246b98 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:15.207571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f5a87400-dbd6-45a5-9fd4-4157c4246b98 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:15.208383 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f5a87400-dbd6-45a5-9fd4-4157c4246b98 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:15.208824 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f5a87400-dbd6-45a5-9fd4-4157c4246b98 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:15.350061 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-602e8131-7fd1-4947-bf00-297f6e22c985 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 28457 microversion: 2.20 time: 0.159965 Dec 23 12:00:15.351473 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 119/260] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:15 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 28457 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:15.421660 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f5a87400-dbd6-45a5-9fd4-4157c4246b98 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:15.429796 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f5a87400-dbd6-45a5-9fd4-4157c4246b98 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.234514 Dec 23 12:00:15.430551 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 142/261] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:15 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:15.539475 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f354a871-44b0-4e87-95bf-2b00067de881 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:15.540177 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f354a871-44b0-4e87-95bf-2b00067de881 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:15.546955 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f354a871-44b0-4e87-95bf-2b00067de881 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:15.547413 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f354a871-44b0-4e87-95bf-2b00067de881 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:15.548186 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f354a871-44b0-4e87-95bf-2b00067de881 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:15.548617 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f354a871-44b0-4e87-95bf-2b00067de881 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:15.696847 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-f354a871-44b0-4e87-95bf-2b00067de881 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:15.707459 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f354a871-44b0-4e87-95bf-2b00067de881 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1314 microversion: 2.1 time: 0.171976 Dec 23 12:00:15.708346 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 120/262] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:15 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:16.362752 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-592ccff1-9c74-433a-86ed-7486d9a0f6e9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:16.363774 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-592ccff1-9c74-433a-86ed-7486d9a0f6e9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:16.370531 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-592ccff1-9c74-433a-86ed-7486d9a0f6e9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:16.371004 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-592ccff1-9c74-433a-86ed-7486d9a0f6e9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:16.371792 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-592ccff1-9c74-433a-86ed-7486d9a0f6e9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:16.372239 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-592ccff1-9c74-433a-86ed-7486d9a0f6e9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:16.450271 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a3927658-fa25-4f27-b22e-fa5e9f623fbc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:16.450976 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a3927658-fa25-4f27-b22e-fa5e9f623fbc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:16.459331 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a3927658-fa25-4f27-b22e-fa5e9f623fbc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:16.459793 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a3927658-fa25-4f27-b22e-fa5e9f623fbc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:16.460575 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a3927658-fa25-4f27-b22e-fa5e9f623fbc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:16.461008 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a3927658-fa25-4f27-b22e-fa5e9f623fbc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:16.601251 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a3927658-fa25-4f27-b22e-fa5e9f623fbc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:16.608574 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a3927658-fa25-4f27-b22e-fa5e9f623fbc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.164201 Dec 23 12:00:16.609145 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 121/263] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:16 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:16.618168 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-592ccff1-9c74-433a-86ed-7486d9a0f6e9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 28576 microversion: 2.20 time: 0.254180 Dec 23 12:00:16.618168 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 143/264] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:16 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 28576 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:16.727890 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8574c58d-e0e4-4971-a2eb-50700dafbc24 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:16.728636 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8574c58d-e0e4-4971-a2eb-50700dafbc24 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:16.736998 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8574c58d-e0e4-4971-a2eb-50700dafbc24 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:16.738082 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8574c58d-e0e4-4971-a2eb-50700dafbc24 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:16.738951 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8574c58d-e0e4-4971-a2eb-50700dafbc24 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:16.739391 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8574c58d-e0e4-4971-a2eb-50700dafbc24 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:16.886056 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8574c58d-e0e4-4971-a2eb-50700dafbc24 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:16.893727 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8574c58d-e0e4-4971-a2eb-50700dafbc24 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1314 microversion: 2.1 time: 0.172572 Dec 23 12:00:16.894352 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 144/265] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:16 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:17.625352 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-7e99662c-9f60-472f-89dc-8b58145e3f53 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:17.625918 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-419ad78b-0ef1-4abb-803a-cf7ce1ab0e86 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:17.626274 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-419ad78b-0ef1-4abb-803a-cf7ce1ab0e86 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:17.626351 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-7e99662c-9f60-472f-89dc-8b58145e3f53 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:17.633024 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7e99662c-9f60-472f-89dc-8b58145e3f53 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:17.633301 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-419ad78b-0ef1-4abb-803a-cf7ce1ab0e86 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:17.633473 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7e99662c-9f60-472f-89dc-8b58145e3f53 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:17.633721 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-419ad78b-0ef1-4abb-803a-cf7ce1ab0e86 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:17.634266 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7e99662c-9f60-472f-89dc-8b58145e3f53 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:17.634538 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-419ad78b-0ef1-4abb-803a-cf7ce1ab0e86 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:17.634738 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7e99662c-9f60-472f-89dc-8b58145e3f53 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:17.634996 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-419ad78b-0ef1-4abb-803a-cf7ce1ab0e86 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:17.766082 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-419ad78b-0ef1-4abb-803a-cf7ce1ab0e86 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:17.773779 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-419ad78b-0ef1-4abb-803a-cf7ce1ab0e86 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.152267 Dec 23 12:00:17.774392 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 145/266] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:17 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:17.795389 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-7e99662c-9f60-472f-89dc-8b58145e3f53 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 28621 microversion: 2.20 time: 0.174066 Dec 23 12:00:17.796037 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 122/267] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:17 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 28621 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:17.917246 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f3fb602a-a13f-42ac-b8ff-e7305ae77891 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:17.917952 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f3fb602a-a13f-42ac-b8ff-e7305ae77891 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:17.926781 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f3fb602a-a13f-42ac-b8ff-e7305ae77891 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:17.927283 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f3fb602a-a13f-42ac-b8ff-e7305ae77891 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:17.928182 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f3fb602a-a13f-42ac-b8ff-e7305ae77891 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:17.928665 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f3fb602a-a13f-42ac-b8ff-e7305ae77891 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:18.066991 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f3fb602a-a13f-42ac-b8ff-e7305ae77891 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:18.075589 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f3fb602a-a13f-42ac-b8ff-e7305ae77891 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1314 microversion: 2.1 time: 0.163339 Dec 23 12:00:18.076152 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 146/268] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:17 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:18.791428 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ff38bbd5-c770-4e95-a5d5-f10de6c6f419 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:18.792152 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ff38bbd5-c770-4e95-a5d5-f10de6c6f419 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:18.799106 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ff38bbd5-c770-4e95-a5d5-f10de6c6f419 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:18.799559 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ff38bbd5-c770-4e95-a5d5-f10de6c6f419 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:18.804767 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ff38bbd5-c770-4e95-a5d5-f10de6c6f419 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:18.805243 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ff38bbd5-c770-4e95-a5d5-f10de6c6f419 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:18.807269 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d70227dc-d8a7-4314-9500-8339239dbd32 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:18.808775 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d70227dc-d8a7-4314-9500-8339239dbd32 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:18.816134 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d70227dc-d8a7-4314-9500-8339239dbd32 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:18.816989 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d70227dc-d8a7-4314-9500-8339239dbd32 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:18.817976 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d70227dc-d8a7-4314-9500-8339239dbd32 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:18.818472 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d70227dc-d8a7-4314-9500-8339239dbd32 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:18.948296 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ff38bbd5-c770-4e95-a5d5-f10de6c6f419 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:18.949351 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d70227dc-d8a7-4314-9500-8339239dbd32 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 28621 microversion: 2.20 time: 0.146251 Dec 23 12:00:18.950000 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 147/269] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:18 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 28621 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:18.956271 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ff38bbd5-c770-4e95-a5d5-f10de6c6f419 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.168731 Dec 23 12:00:18.956810 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 123/270] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:18 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:19.095911 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9118052f-6b17-42d9-b997-37da7339a89f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:19.096932 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9118052f-6b17-42d9-b997-37da7339a89f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:19.104220 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9118052f-6b17-42d9-b997-37da7339a89f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:19.104673 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9118052f-6b17-42d9-b997-37da7339a89f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:19.105453 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9118052f-6b17-42d9-b997-37da7339a89f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:19.105892 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9118052f-6b17-42d9-b997-37da7339a89f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:19.256998 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9118052f-6b17-42d9-b997-37da7339a89f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:19.264392 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9118052f-6b17-42d9-b997-37da7339a89f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1314 microversion: 2.1 time: 0.174652 Dec 23 12:00:19.264987 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 148/271] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:19 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:19.960930 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d5fda056-4dbd-40f1-a9e2-0aa0ab8edd4e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:19.961933 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d5fda056-4dbd-40f1-a9e2-0aa0ab8edd4e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:19.968441 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d5fda056-4dbd-40f1-a9e2-0aa0ab8edd4e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:19.968911 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d5fda056-4dbd-40f1-a9e2-0aa0ab8edd4e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:19.969694 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d5fda056-4dbd-40f1-a9e2-0aa0ab8edd4e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:19.970135 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d5fda056-4dbd-40f1-a9e2-0aa0ab8edd4e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:19.973703 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2a645cbf-83fb-43f5-bc9d-16dee8e1ba19 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:19.974539 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2a645cbf-83fb-43f5-bc9d-16dee8e1ba19 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:19.981016 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2a645cbf-83fb-43f5-bc9d-16dee8e1ba19 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:19.981555 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2a645cbf-83fb-43f5-bc9d-16dee8e1ba19 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:19.982363 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2a645cbf-83fb-43f5-bc9d-16dee8e1ba19 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:19.983026 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2a645cbf-83fb-43f5-bc9d-16dee8e1ba19 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:20.097464 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d5fda056-4dbd-40f1-a9e2-0aa0ab8edd4e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 28621 microversion: 2.20 time: 0.140250 Dec 23 12:00:20.098341 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 124/272] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:19 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 28621 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:20.117249 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2a645cbf-83fb-43f5-bc9d-16dee8e1ba19 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:20.124464 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2a645cbf-83fb-43f5-bc9d-16dee8e1ba19 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.154989 Dec 23 12:00:20.125223 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 149/273] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:19 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:20.280371 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3a79e6b2-769d-4406-8a41-eb151db874dd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:20.281062 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3a79e6b2-769d-4406-8a41-eb151db874dd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:20.293689 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3a79e6b2-769d-4406-8a41-eb151db874dd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:20.294139 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3a79e6b2-769d-4406-8a41-eb151db874dd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:20.294971 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3a79e6b2-769d-4406-8a41-eb151db874dd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:20.295408 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3a79e6b2-769d-4406-8a41-eb151db874dd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:20.440260 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3a79e6b2-769d-4406-8a41-eb151db874dd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:20.447860 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3a79e6b2-769d-4406-8a41-eb151db874dd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1314 microversion: 2.1 time: 0.171394 Dec 23 12:00:20.448442 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 125/274] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:20 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:20.674166 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-f9072316-4528-454a-8101-62dae95fa96c req-a434711c-4923-4ea8-980a-00376ba5f25f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7549231-99ea-452a-abd4-cfd75b597880", "name": "network-vif-plugged", "status": "completed", "tag": "a50bdab5-72fe-4fc4-9208-6cb238170521"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:20.675678 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:00:20.675678 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:00:20.683206 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-f9072316-4528-454a-8101-62dae95fa96c req-a434711c-4923-4ea8-980a-00376ba5f25f service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:20.683658 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-f9072316-4528-454a-8101-62dae95fa96c req-a434711c-4923-4ea8-980a-00376ba5f25f service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:20.698472 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-f9072316-4528-454a-8101-62dae95fa96c req-a434711c-4923-4ea8-980a-00376ba5f25f service nova] Creating event network-vif-plugged:a50bdab5-72fe-4fc4-9208-6cb238170521 for instance b7549231-99ea-452a-abd4-cfd75b597880 on hv-cinder-82282 Dec 23 12:00:20.703486 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-f9072316-4528-454a-8101-62dae95fa96c req-a434711c-4923-4ea8-980a-00376ba5f25f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032925 Dec 23 12:00:20.704234 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 150/275] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:00:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:00:21.109035 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-68ea61fd-99b3-4498-86bd-afcd44ce3e1f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:21.109963 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-68ea61fd-99b3-4498-86bd-afcd44ce3e1f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:21.117289 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-68ea61fd-99b3-4498-86bd-afcd44ce3e1f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:21.117743 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-68ea61fd-99b3-4498-86bd-afcd44ce3e1f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:21.118545 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-68ea61fd-99b3-4498-86bd-afcd44ce3e1f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:21.118997 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-68ea61fd-99b3-4498-86bd-afcd44ce3e1f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:21.142638 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-634ecccf-2179-4d98-8fdc-4702a76f61cb tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:21.143998 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-634ecccf-2179-4d98-8fdc-4702a76f61cb tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:21.151766 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-634ecccf-2179-4d98-8fdc-4702a76f61cb tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:21.152599 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-634ecccf-2179-4d98-8fdc-4702a76f61cb tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:21.153408 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-634ecccf-2179-4d98-8fdc-4702a76f61cb tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:21.153849 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-634ecccf-2179-4d98-8fdc-4702a76f61cb tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:21.304066 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-634ecccf-2179-4d98-8fdc-4702a76f61cb tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:21.312077 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-634ecccf-2179-4d98-8fdc-4702a76f61cb tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.174241 Dec 23 12:00:21.312847 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 151/276] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:21 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:00:21.465075 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a750e9fe-418e-42ea-9831-ea0c5d506f37 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:21.465597 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a750e9fe-418e-42ea-9831-ea0c5d506f37 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:21.471956 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a750e9fe-418e-42ea-9831-ea0c5d506f37 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:21.472403 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a750e9fe-418e-42ea-9831-ea0c5d506f37 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:21.473631 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a750e9fe-418e-42ea-9831-ea0c5d506f37 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:21.474230 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a750e9fe-418e-42ea-9831-ea0c5d506f37 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:21.550748 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-68ea61fd-99b3-4498-86bd-afcd44ce3e1f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 28621 microversion: 2.20 time: 0.445153 Dec 23 12:00:21.551868 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 126/277] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:21 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 28621 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:21.717049 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-a750e9fe-418e-42ea-9831-ea0c5d506f37 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:21.725146 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a750e9fe-418e-42ea-9831-ea0c5d506f37 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1314 microversion: 2.1 time: 0.263887 Dec 23 12:00:21.725858 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 152/278] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:21 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:00:22.331018 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-1198051a-8a4a-4932-b211-f5bbbf3f2679 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:22.331836 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-1198051a-8a4a-4932-b211-f5bbbf3f2679 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:22.339688 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1198051a-8a4a-4932-b211-f5bbbf3f2679 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:22.340138 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1198051a-8a4a-4932-b211-f5bbbf3f2679 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:22.340913 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1198051a-8a4a-4932-b211-f5bbbf3f2679 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:22.341531 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1198051a-8a4a-4932-b211-f5bbbf3f2679 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:22.493583 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-1198051a-8a4a-4932-b211-f5bbbf3f2679 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:22.501350 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-1198051a-8a4a-4932-b211-f5bbbf3f2679 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.175245 Dec 23 12:00:22.502108 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 127/279] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:22 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:00:22.563747 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-70e6f175-3f69-44b7-b696-ff4157d45683 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:22.565354 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-70e6f175-3f69-44b7-b696-ff4157d45683 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:22.572140 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-70e6f175-3f69-44b7-b696-ff4157d45683 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:22.572581 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-70e6f175-3f69-44b7-b696-ff4157d45683 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:22.573368 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-70e6f175-3f69-44b7-b696-ff4157d45683 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:22.573802 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-70e6f175-3f69-44b7-b696-ff4157d45683 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:22.746201 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-08033782-b6f7-4b06-abd4-bf359bfb9e0a tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:22.746201 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-08033782-b6f7-4b06-abd4-bf359bfb9e0a tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:22.752484 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-08033782-b6f7-4b06-abd4-bf359bfb9e0a tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:22.753001 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-08033782-b6f7-4b06-abd4-bf359bfb9e0a tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:22.753854 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-08033782-b6f7-4b06-abd4-bf359bfb9e0a tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:22.754372 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-08033782-b6f7-4b06-abd4-bf359bfb9e0a tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:22.760698 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-70e6f175-3f69-44b7-b696-ff4157d45683 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 28621 microversion: 2.20 time: 0.201469 Dec 23 12:00:22.761381 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 153/280] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:22 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 28621 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:22.894033 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-08033782-b6f7-4b06-abd4-bf359bfb9e0a tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:22.902487 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-08033782-b6f7-4b06-abd4-bf359bfb9e0a tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1314 microversion: 2.1 time: 0.163989 Dec 23 12:00:22.903302 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 128/281] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:22 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:23.518912 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-30cd7aad-f10c-47fe-8731-adc86391c9e0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:23.519619 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-30cd7aad-f10c-47fe-8731-adc86391c9e0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:23.526673 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-30cd7aad-f10c-47fe-8731-adc86391c9e0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:23.527136 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-30cd7aad-f10c-47fe-8731-adc86391c9e0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:23.527926 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-30cd7aad-f10c-47fe-8731-adc86391c9e0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:23.528363 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-30cd7aad-f10c-47fe-8731-adc86391c9e0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:23.674246 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-30cd7aad-f10c-47fe-8731-adc86391c9e0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:23.680188 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-30cd7aad-f10c-47fe-8731-adc86391c9e0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.165603 Dec 23 12:00:23.680723 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 154/282] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:23 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:23.772851 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-81a9fc9b-2640-42b6-a73f-e321b235fb8f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:23.773767 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-81a9fc9b-2640-42b6-a73f-e321b235fb8f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:23.780531 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-81a9fc9b-2640-42b6-a73f-e321b235fb8f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:23.780981 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-81a9fc9b-2640-42b6-a73f-e321b235fb8f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:23.781760 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-81a9fc9b-2640-42b6-a73f-e321b235fb8f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:23.782190 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-81a9fc9b-2640-42b6-a73f-e321b235fb8f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:23.918771 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e28e5906-51e7-475f-bf0d-612168c0611f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:23.919491 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e28e5906-51e7-475f-bf0d-612168c0611f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:23.925851 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e28e5906-51e7-475f-bf0d-612168c0611f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:23.926314 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e28e5906-51e7-475f-bf0d-612168c0611f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:23.927375 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e28e5906-51e7-475f-bf0d-612168c0611f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:23.927834 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e28e5906-51e7-475f-bf0d-612168c0611f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:24.059157 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e28e5906-51e7-475f-bf0d-612168c0611f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:24.067793 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e28e5906-51e7-475f-bf0d-612168c0611f tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1498 microversion: 2.1 time: 0.152616 Dec 23 12:00:24.068363 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 155/283] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:23 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:00:24.696837 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ddacc9d0-6d65-4467-af38-88283697e3b5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:24.697426 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ddacc9d0-6d65-4467-af38-88283697e3b5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:24.706386 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ddacc9d0-6d65-4467-af38-88283697e3b5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:24.706900 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ddacc9d0-6d65-4467-af38-88283697e3b5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:24.707842 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ddacc9d0-6d65-4467-af38-88283697e3b5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:24.708283 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ddacc9d0-6d65-4467-af38-88283697e3b5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:24.847236 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ddacc9d0-6d65-4467-af38-88283697e3b5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:24.854665 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ddacc9d0-6d65-4467-af38-88283697e3b5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.161551 Dec 23 12:00:24.855229 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 156/284] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:24 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:25.876400 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0ee3a7b1-d023-4a87-9952-8163c7e3cd64 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:25.877385 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0ee3a7b1-d023-4a87-9952-8163c7e3cd64 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:25.885454 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0ee3a7b1-d023-4a87-9952-8163c7e3cd64 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:25.885917 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0ee3a7b1-d023-4a87-9952-8163c7e3cd64 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:25.886816 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0ee3a7b1-d023-4a87-9952-8163c7e3cd64 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:25.887260 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0ee3a7b1-d023-4a87-9952-8163c7e3cd64 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:26.024038 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0ee3a7b1-d023-4a87-9952-8163c7e3cd64 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:26.031812 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0ee3a7b1-d023-4a87-9952-8163c7e3cd64 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.162086 Dec 23 12:00:26.032372 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 157/285] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:25 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:27.052355 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-76d69900-04b3-4f47-a777-9ef302b6a873 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:27.053049 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-76d69900-04b3-4f47-a777-9ef302b6a873 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:27.059793 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-76d69900-04b3-4f47-a777-9ef302b6a873 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:27.060245 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-76d69900-04b3-4f47-a777-9ef302b6a873 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:27.061029 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-76d69900-04b3-4f47-a777-9ef302b6a873 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:27.061468 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-76d69900-04b3-4f47-a777-9ef302b6a873 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:27.081270 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-81a9fc9b-2640-42b6-a73f-e321b235fb8f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 28621 microversion: 2.20 time: 3.311988 Dec 23 12:00:27.082041 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 129/286] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:23 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 28621 bytes in 3314 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:27.211546 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-76d69900-04b3-4f47-a777-9ef302b6a873 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:27.219257 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-76d69900-04b3-4f47-a777-9ef302b6a873 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.172763 Dec 23 12:00:27.220024 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 158/287] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:27 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:00:27.940943 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-085eb786-e861-4665-a175-c7ca8d328d85 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:27.941561 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-085eb786-e861-4665-a175-c7ca8d328d85 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:27.948823 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-085eb786-e861-4665-a175-c7ca8d328d85 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:27.949266 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-085eb786-e861-4665-a175-c7ca8d328d85 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:27.950012 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-085eb786-e861-4665-a175-c7ca8d328d85 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:27.950465 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-085eb786-e861-4665-a175-c7ca8d328d85 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:27.976413 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-085eb786-e861-4665-a175-c7ca8d328d85 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Going to try to terminate instance {{(pid=116355) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:00:28.137563 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9e095700-9dc1-46e7-877a-70b96e0a14b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:28.138490 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9e095700-9dc1-46e7-877a-70b96e0a14b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:28.145891 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9e095700-9dc1-46e7-877a-70b96e0a14b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:28.146334 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9e095700-9dc1-46e7-877a-70b96e0a14b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:28.147176 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9e095700-9dc1-46e7-877a-70b96e0a14b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:28.147603 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9e095700-9dc1-46e7-877a-70b96e0a14b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:28.208119 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-085eb786-e861-4665-a175-c7ca8d328d85 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 204 len: 0 microversion: 2.1 time: 0.270743 Dec 23 12:00:28.208980 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 130/288] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:00:27 2021] DELETE /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:00:28.219367 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-9ed45ab3-485d-460e-b5c9-617ace6f624c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:28.220062 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-9ed45ab3-485d-460e-b5c9-617ace6f624c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:28.226678 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9ed45ab3-485d-460e-b5c9-617ace6f624c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:28.227107 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9ed45ab3-485d-460e-b5c9-617ace6f624c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:28.227915 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9ed45ab3-485d-460e-b5c9-617ace6f624c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:28.228408 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9ed45ab3-485d-460e-b5c9-617ace6f624c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:28.370262 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-9ed45ab3-485d-460e-b5c9-617ace6f624c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:28.379365 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-9ed45ab3-485d-460e-b5c9-617ace6f624c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1504 microversion: 2.1 time: 0.165325 Dec 23 12:00:28.379807 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 131/289] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:28 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:28.384279 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-21d68141-1461-4a3a-b888-308cf863c012 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:28.385057 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-21d68141-1461-4a3a-b888-308cf863c012 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:28.393260 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-21d68141-1461-4a3a-b888-308cf863c012 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:28.393915 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-21d68141-1461-4a3a-b888-308cf863c012 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:28.394811 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-21d68141-1461-4a3a-b888-308cf863c012 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:28.395261 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-21d68141-1461-4a3a-b888-308cf863c012 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:28.530996 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-21d68141-1461-4a3a-b888-308cf863c012 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:28.538569 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-21d68141-1461-4a3a-b888-308cf863c012 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.157761 Dec 23 12:00:28.539153 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 132/290] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:28 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:29.398292 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-672db21d-ff25-4bcb-a2a2-3134a8855d71 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:29.398903 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-672db21d-ff25-4bcb-a2a2-3134a8855d71 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:29.408702 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-672db21d-ff25-4bcb-a2a2-3134a8855d71 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:29.409271 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-672db21d-ff25-4bcb-a2a2-3134a8855d71 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:29.410402 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-672db21d-ff25-4bcb-a2a2-3134a8855d71 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:29.410908 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-672db21d-ff25-4bcb-a2a2-3134a8855d71 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:29.550185 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-672db21d-ff25-4bcb-a2a2-3134a8855d71 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:29.558833 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-672db21d-ff25-4bcb-a2a2-3134a8855d71 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1504 microversion: 2.1 time: 0.166237 Dec 23 12:00:29.559410 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 133/291] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:29 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:29.563627 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-beb488dd-8391-4fae-a243-d9d0b21f8add tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:29.564240 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-beb488dd-8391-4fae-a243-d9d0b21f8add tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:29.570263 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-beb488dd-8391-4fae-a243-d9d0b21f8add tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:29.570759 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-beb488dd-8391-4fae-a243-d9d0b21f8add tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:29.571547 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-beb488dd-8391-4fae-a243-d9d0b21f8add tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:29.571984 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-beb488dd-8391-4fae-a243-d9d0b21f8add tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:29.708432 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-beb488dd-8391-4fae-a243-d9d0b21f8add tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:29.716278 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-beb488dd-8391-4fae-a243-d9d0b21f8add tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.155925 Dec 23 12:00:29.716860 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 134/292] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:29 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:30.577454 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2ede2e23-fd92-44f8-8c99-c9f096210ca9 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:30.578160 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2ede2e23-fd92-44f8-8c99-c9f096210ca9 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:30.585862 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2ede2e23-fd92-44f8-8c99-c9f096210ca9 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:30.586311 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2ede2e23-fd92-44f8-8c99-c9f096210ca9 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:30.587140 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2ede2e23-fd92-44f8-8c99-c9f096210ca9 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:30.587568 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2ede2e23-fd92-44f8-8c99-c9f096210ca9 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:30.747380 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-2ede2e23-fd92-44f8-8c99-c9f096210ca9 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:30.756232 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2ede2e23-fd92-44f8-8c99-c9f096210ca9 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1504 microversion: 2.1 time: 0.183394 Dec 23 12:00:30.756834 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 135/293] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:30 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:30.761169 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0df2af19-418f-42c5-b85f-a8f653a05ef8 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:30.761776 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0df2af19-418f-42c5-b85f-a8f653a05ef8 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:30.768234 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0df2af19-418f-42c5-b85f-a8f653a05ef8 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:30.768694 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0df2af19-418f-42c5-b85f-a8f653a05ef8 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:30.769484 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0df2af19-418f-42c5-b85f-a8f653a05ef8 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:30.770159 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0df2af19-418f-42c5-b85f-a8f653a05ef8 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:30.913387 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0df2af19-418f-42c5-b85f-a8f653a05ef8 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:30.921074 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0df2af19-418f-42c5-b85f-a8f653a05ef8 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.163216 Dec 23 12:00:30.921626 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 136/294] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:30 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:31.777385 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8732aa01-885f-446f-8819-a56ea1b16f91 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:31.778406 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-8732aa01-885f-446f-8819-a56ea1b16f91 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:31.787929 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8732aa01-885f-446f-8819-a56ea1b16f91 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:31.788384 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8732aa01-885f-446f-8819-a56ea1b16f91 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:31.789157 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8732aa01-885f-446f-8819-a56ea1b16f91 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:31.789589 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8732aa01-885f-446f-8819-a56ea1b16f91 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:31.925389 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-8732aa01-885f-446f-8819-a56ea1b16f91 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:31.933385 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-8732aa01-885f-446f-8819-a56ea1b16f91 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1504 microversion: 2.1 time: 0.162414 Dec 23 12:00:31.933962 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 137/295] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:31 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:31.941901 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d1f4c84c-e601-4243-a872-9655481a035d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:31.942827 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d1f4c84c-e601-4243-a872-9655481a035d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:31.943643 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9e095700-9dc1-46e7-877a-70b96e0a14b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 32043 microversion: 2.20 time: 3.809216 Dec 23 12:00:31.949751 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 159/296] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:28 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 32043 bytes in 3812 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:31.950129 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d1f4c84c-e601-4243-a872-9655481a035d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:31.950129 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d1f4c84c-e601-4243-a872-9655481a035d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:31.950978 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d1f4c84c-e601-4243-a872-9655481a035d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:31.951450 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d1f4c84c-e601-4243-a872-9655481a035d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:32.079912 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d1f4c84c-e601-4243-a872-9655481a035d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:32.087887 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d1f4c84c-e601-4243-a872-9655481a035d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.152985 Dec 23 12:00:32.088664 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 138/297] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:31 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:32.951842 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-02876528-c8c5-4d9f-921c-c9833069e66e tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:32.952862 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-02876528-c8c5-4d9f-921c-c9833069e66e tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:32.957478 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-67688a19-3ff5-411a-afc6-a476555df135 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:32.958824 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-67688a19-3ff5-411a-afc6-a476555df135 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:32.960062 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-02876528-c8c5-4d9f-921c-c9833069e66e tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:32.960551 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-02876528-c8c5-4d9f-921c-c9833069e66e tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:32.961373 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-02876528-c8c5-4d9f-921c-c9833069e66e tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:32.961812 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-02876528-c8c5-4d9f-921c-c9833069e66e tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:32.965300 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-67688a19-3ff5-411a-afc6-a476555df135 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:32.965740 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-67688a19-3ff5-411a-afc6-a476555df135 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:32.966628 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-67688a19-3ff5-411a-afc6-a476555df135 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:32.970229 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-67688a19-3ff5-411a-afc6-a476555df135 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:33.132570 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-67688a19-3ff5-411a-afc6-a476555df135 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 33303 microversion: 2.20 time: 0.180099 Dec 23 12:00:33.133906 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 139/298] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:32 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 33303 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:33.134093 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-02876528-c8c5-4d9f-921c-c9833069e66e tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:33.139351 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d16b2ea7-e34c-4f25-8617-15014b8a451a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:33.140688 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d16b2ea7-e34c-4f25-8617-15014b8a451a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:33.143383 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-02876528-c8c5-4d9f-921c-c9833069e66e tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1504 microversion: 2.1 time: 0.195776 Dec 23 12:00:33.144033 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 160/299] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:32 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:33.152931 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d16b2ea7-e34c-4f25-8617-15014b8a451a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:33.152931 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d16b2ea7-e34c-4f25-8617-15014b8a451a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:33.152931 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d16b2ea7-e34c-4f25-8617-15014b8a451a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:33.152931 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d16b2ea7-e34c-4f25-8617-15014b8a451a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:33.285561 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d16b2ea7-e34c-4f25-8617-15014b8a451a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:33.296042 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d16b2ea7-e34c-4f25-8617-15014b8a451a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1522 microversion: 2.1 time: 0.161516 Dec 23 12:00:33.298880 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 140/300] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:33 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:34.144875 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-03323ff3-c171-4781-a5a0-2b4346ef0a2c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:34.146020 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-03323ff3-c171-4781-a5a0-2b4346ef0a2c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:34.152409 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-03323ff3-c171-4781-a5a0-2b4346ef0a2c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:34.152871 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-03323ff3-c171-4781-a5a0-2b4346ef0a2c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:34.153642 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-03323ff3-c171-4781-a5a0-2b4346ef0a2c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:34.154098 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-03323ff3-c171-4781-a5a0-2b4346ef0a2c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:34.160270 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-aea7a6f3-acc0-4af4-aa04-f25043c9c52a tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:34.160992 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-aea7a6f3-acc0-4af4-aa04-f25043c9c52a tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:34.167482 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aea7a6f3-acc0-4af4-aa04-f25043c9c52a tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:34.168268 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aea7a6f3-acc0-4af4-aa04-f25043c9c52a tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:34.169063 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aea7a6f3-acc0-4af4-aa04-f25043c9c52a tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:34.169500 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aea7a6f3-acc0-4af4-aa04-f25043c9c52a tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:34.303223 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-aea7a6f3-acc0-4af4-aa04-f25043c9c52a tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:34.310752 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-aea7a6f3-acc0-4af4-aa04-f25043c9c52a tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1504 microversion: 2.1 time: 0.154103 Dec 23 12:00:34.311324 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 141/301] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:34 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:00:34.323648 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-dfecfdae-16f0-445b-8de0-ef47c8d70492 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:34.324303 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-dfecfdae-16f0-445b-8de0-ef47c8d70492 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:34.330165 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dfecfdae-16f0-445b-8de0-ef47c8d70492 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:34.330853 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dfecfdae-16f0-445b-8de0-ef47c8d70492 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:34.331643 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dfecfdae-16f0-445b-8de0-ef47c8d70492 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:34.332078 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dfecfdae-16f0-445b-8de0-ef47c8d70492 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:34.471684 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-dfecfdae-16f0-445b-8de0-ef47c8d70492 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:34.479218 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-dfecfdae-16f0-445b-8de0-ef47c8d70492 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1502 microversion: 2.1 time: 0.166925 Dec 23 12:00:34.479856 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 142/302] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:34 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:34.495284 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-114810b1-ad96-4a9e-80fa-0ba974769e7d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:34.495890 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-114810b1-ad96-4a9e-80fa-0ba974769e7d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:34.501878 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-114810b1-ad96-4a9e-80fa-0ba974769e7d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:34.502548 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-114810b1-ad96-4a9e-80fa-0ba974769e7d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:34.503346 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-114810b1-ad96-4a9e-80fa-0ba974769e7d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:34.503785 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-114810b1-ad96-4a9e-80fa-0ba974769e7d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:34.651615 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-114810b1-ad96-4a9e-80fa-0ba974769e7d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:34.659090 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-114810b1-ad96-4a9e-80fa-0ba974769e7d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1516 microversion: 2.1 time: 0.167502 Dec 23 12:00:34.659706 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 143/303] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:34 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:00:35.329216 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b0553644-0835-45f4-9141-846a14873ebf tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:35.329826 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b0553644-0835-45f4-9141-846a14873ebf tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:35.339122 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b0553644-0835-45f4-9141-846a14873ebf tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:35.339729 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b0553644-0835-45f4-9141-846a14873ebf tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:35.340641 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b0553644-0835-45f4-9141-846a14873ebf tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:35.341308 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b0553644-0835-45f4-9141-846a14873ebf tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:35.478319 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b0553644-0835-45f4-9141-846a14873ebf tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:35.486310 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b0553644-0835-45f4-9141-846a14873ebf tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1504 microversion: 2.1 time: 0.162369 Dec 23 12:00:35.486911 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 144/304] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:35 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:36.507502 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-50c49768-4064-4445-9386-7eee0b6f5736 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:36.508435 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-50c49768-4064-4445-9386-7eee0b6f5736 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:36.519027 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-50c49768-4064-4445-9386-7eee0b6f5736 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:36.519780 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-50c49768-4064-4445-9386-7eee0b6f5736 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:36.520918 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-50c49768-4064-4445-9386-7eee0b6f5736 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:36.521351 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-50c49768-4064-4445-9386-7eee0b6f5736 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:36.659478 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-50c49768-4064-4445-9386-7eee0b6f5736 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:36.667817 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-50c49768-4064-4445-9386-7eee0b6f5736 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1504 microversion: 2.1 time: 0.167002 Dec 23 12:00:36.668383 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 145/305] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:36 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:37.688737 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0be612a1-d360-4d58-981e-cc050534f69c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:37.689805 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0be612a1-d360-4d58-981e-cc050534f69c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:37.697662 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0be612a1-d360-4d58-981e-cc050534f69c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:37.698131 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0be612a1-d360-4d58-981e-cc050534f69c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:37.698980 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0be612a1-d360-4d58-981e-cc050534f69c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:37.699428 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0be612a1-d360-4d58-981e-cc050534f69c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:37.835661 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0be612a1-d360-4d58-981e-cc050534f69c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:37.843542 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0be612a1-d360-4d58-981e-cc050534f69c tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1504 microversion: 2.1 time: 0.160917 Dec 23 12:00:37.844100 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 146/306] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:37 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:38.046126 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-03323ff3-c171-4781-a5a0-2b4346ef0a2c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 35748 microversion: 2.20 time: 3.904388 Dec 23 12:00:38.047120 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 161/307] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:34 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 35748 bytes in 3907 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:38.864576 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-974d11f7-3a1f-4694-ad6b-3eaff0193cdd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:38.865178 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-974d11f7-3a1f-4694-ad6b-3eaff0193cdd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:38.871912 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-974d11f7-3a1f-4694-ad6b-3eaff0193cdd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:38.872370 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-974d11f7-3a1f-4694-ad6b-3eaff0193cdd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:38.873150 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-974d11f7-3a1f-4694-ad6b-3eaff0193cdd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:38.873585 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-974d11f7-3a1f-4694-ad6b-3eaff0193cdd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:39.010406 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-974d11f7-3a1f-4694-ad6b-3eaff0193cdd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:39.018073 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-974d11f7-3a1f-4694-ad6b-3eaff0193cdd tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1504 microversion: 2.1 time: 0.159935 Dec 23 12:00:39.026388 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 147/308] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:38 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:39.060656 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d3283fad-f056-4c77-bc7f-ca2c66821523 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:39.061687 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d3283fad-f056-4c77-bc7f-ca2c66821523 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:39.069262 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d3283fad-f056-4c77-bc7f-ca2c66821523 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:39.069702 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d3283fad-f056-4c77-bc7f-ca2c66821523 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:39.070479 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d3283fad-f056-4c77-bc7f-ca2c66821523 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:39.070936 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d3283fad-f056-4c77-bc7f-ca2c66821523 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:39.412013 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d3283fad-f056-4c77-bc7f-ca2c66821523 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 36547 microversion: 2.20 time: 0.355506 Dec 23 12:00:39.413725 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 162/309] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:39 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 36547 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:40.034001 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-35db8a85-b56e-4e61-b302-41b9c3568ed8 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:40.034676 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-35db8a85-b56e-4e61-b302-41b9c3568ed8 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:40.041409 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-35db8a85-b56e-4e61-b302-41b9c3568ed8 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:40.041871 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-35db8a85-b56e-4e61-b302-41b9c3568ed8 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:40.042693 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-35db8a85-b56e-4e61-b302-41b9c3568ed8 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:40.043135 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-35db8a85-b56e-4e61-b302-41b9c3568ed8 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:40.235022 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2147acab-7ae9-462c-b3ca-ac17a8137cca tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:40.236516 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2147acab-7ae9-462c-b3ca-ac17a8137cca tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:40.243890 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2147acab-7ae9-462c-b3ca-ac17a8137cca tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:40.244478 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2147acab-7ae9-462c-b3ca-ac17a8137cca tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:40.245319 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2147acab-7ae9-462c-b3ca-ac17a8137cca tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:40.245826 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2147acab-7ae9-462c-b3ca-ac17a8137cca tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:40.269998 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-2147acab-7ae9-462c-b3ca-ac17a8137cca tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lazy-loading 'flavor' on Instance uuid 15f88906-0a5f-47a4-bf35-55db395a0e97 {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:00:40.348489 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2147acab-7ae9-462c-b3ca-ac17a8137cca tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "POST /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/action" status: 200 len: 32 microversion: 2.1 time: 0.117703 Dec 23 12:00:40.349368 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 163/310] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:00:40 2021] POST /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/action => generated 32 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 23 12:00:40.358747 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-78ec79de-8b6d-4758-84f7-9bc340fedeb9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:40.359473 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-78ec79de-8b6d-4758-84f7-9bc340fedeb9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:40.370910 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-78ec79de-8b6d-4758-84f7-9bc340fedeb9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:40.371218 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-78ec79de-8b6d-4758-84f7-9bc340fedeb9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:40.372621 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-78ec79de-8b6d-4758-84f7-9bc340fedeb9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:40.373125 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-78ec79de-8b6d-4758-84f7-9bc340fedeb9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:40.427811 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-35db8a85-b56e-4e61-b302-41b9c3568ed8 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:40.436351 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-35db8a85-b56e-4e61-b302-41b9c3568ed8 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1504 microversion: 2.1 time: 0.406056 Dec 23 12:00:40.437038 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 148/311] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:40 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:40.442341 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-92138de0-75a6-4ca8-925c-f8fef518865c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:40.443933 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-92138de0-75a6-4ca8-925c-f8fef518865c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:40.453791 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-92138de0-75a6-4ca8-925c-f8fef518865c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:40.454251 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-92138de0-75a6-4ca8-925c-f8fef518865c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:40.455078 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-92138de0-75a6-4ca8-925c-f8fef518865c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:40.455517 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-92138de0-75a6-4ca8-925c-f8fef518865c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:40.543430 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-78ec79de-8b6d-4758-84f7-9bc340fedeb9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:40.550785 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-78ec79de-8b6d-4758-84f7-9bc340fedeb9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.196111 Dec 23 12:00:40.551416 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 164/312] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:40 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:00:40.555842 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-476e54bf-d397-4ec2-89ac-f370d0ce2e11 req-80d86614-5cd1-42b3-9d24-b43c8e29a688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7549231-99ea-452a-abd4-cfd75b597880", "name": "network-vif-deleted", "tag": "a50bdab5-72fe-4fc4-9208-6cb238170521"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:40.557340 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:00:40.557340 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:00:40.564208 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-476e54bf-d397-4ec2-89ac-f370d0ce2e11 req-80d86614-5cd1-42b3-9d24-b43c8e29a688 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:40.564692 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-476e54bf-d397-4ec2-89ac-f370d0ce2e11 req-80d86614-5cd1-42b3-9d24-b43c8e29a688 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:40.575748 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-476e54bf-d397-4ec2-89ac-f370d0ce2e11 req-80d86614-5cd1-42b3-9d24-b43c8e29a688 service nova] Creating event network-vif-deleted:a50bdab5-72fe-4fc4-9208-6cb238170521 for instance b7549231-99ea-452a-abd4-cfd75b597880 on hv-cinder-82282 Dec 23 12:00:40.580912 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-476e54bf-d397-4ec2-89ac-f370d0ce2e11 req-80d86614-5cd1-42b3-9d24-b43c8e29a688 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028307 Dec 23 12:00:40.581472 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 165/313] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:00:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:00:41.456865 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0c739a32-508c-4a6f-870f-35e1eaced811 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:41.457619 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0c739a32-508c-4a6f-870f-35e1eaced811 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:41.464698 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0c739a32-508c-4a6f-870f-35e1eaced811 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:41.465152 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0c739a32-508c-4a6f-870f-35e1eaced811 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:41.465932 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0c739a32-508c-4a6f-870f-35e1eaced811 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:41.466441 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0c739a32-508c-4a6f-870f-35e1eaced811 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:41.526626 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0c739a32-508c-4a6f-870f-35e1eaced811 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:41.534087 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0c739a32-508c-4a6f-870f-35e1eaced811 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1462 microversion: 2.1 time: 0.083887 Dec 23 12:00:41.534759 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 166/314] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:41 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1462 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:41.568179 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c3237f62-dc66-4697-a386-9bdd0b04fbcc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:41.568912 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c3237f62-dc66-4697-a386-9bdd0b04fbcc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:41.575122 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c3237f62-dc66-4697-a386-9bdd0b04fbcc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:41.575585 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c3237f62-dc66-4697-a386-9bdd0b04fbcc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:41.576391 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c3237f62-dc66-4697-a386-9bdd0b04fbcc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:41.576799 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c3237f62-dc66-4697-a386-9bdd0b04fbcc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:41.722203 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c3237f62-dc66-4697-a386-9bdd0b04fbcc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:41.729724 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c3237f62-dc66-4697-a386-9bdd0b04fbcc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.165346 Dec 23 12:00:41.730301 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 167/315] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:41 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:42.554203 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0981927e-087f-4db6-a4d3-56f0e4f9daaa tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:42.554826 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0981927e-087f-4db6-a4d3-56f0e4f9daaa tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:42.561627 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0981927e-087f-4db6-a4d3-56f0e4f9daaa tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:42.562148 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0981927e-087f-4db6-a4d3-56f0e4f9daaa tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:42.562973 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0981927e-087f-4db6-a4d3-56f0e4f9daaa tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:42.563412 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0981927e-087f-4db6-a4d3-56f0e4f9daaa tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:42.626216 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0981927e-087f-4db6-a4d3-56f0e4f9daaa tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:42.634196 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0981927e-087f-4db6-a4d3-56f0e4f9daaa tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1462 microversion: 2.1 time: 0.085771 Dec 23 12:00:42.634801 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 168/316] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:42 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1462 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:42.747658 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-eba7df63-c92b-41e3-a886-e383a9a117c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:42.748367 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-eba7df63-c92b-41e3-a886-e383a9a117c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:42.755692 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-eba7df63-c92b-41e3-a886-e383a9a117c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:42.756147 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-eba7df63-c92b-41e3-a886-e383a9a117c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:42.757121 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-eba7df63-c92b-41e3-a886-e383a9a117c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:42.757456 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-eba7df63-c92b-41e3-a886-e383a9a117c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:42.897290 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-eba7df63-c92b-41e3-a886-e383a9a117c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:42.905183 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-eba7df63-c92b-41e3-a886-e383a9a117c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.161376 Dec 23 12:00:42.905747 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 169/317] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:42 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:43.651204 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a6258739-3e7e-4869-87a9-7680e225de3b tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:43.651870 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a6258739-3e7e-4869-87a9-7680e225de3b tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:43.658778 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a6258739-3e7e-4869-87a9-7680e225de3b tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:43.659236 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a6258739-3e7e-4869-87a9-7680e225de3b tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:43.660054 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a6258739-3e7e-4869-87a9-7680e225de3b tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:43.660521 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a6258739-3e7e-4869-87a9-7680e225de3b tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:43.722287 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-a6258739-3e7e-4869-87a9-7680e225de3b tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:43.731796 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a6258739-3e7e-4869-87a9-7680e225de3b tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1462 microversion: 2.1 time: 0.084749 Dec 23 12:00:43.732363 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 170/318] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:43 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:00:43.923924 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-92aad70e-4edd-431d-b3ea-574f9f18cce9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:43.924669 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-92aad70e-4edd-431d-b3ea-574f9f18cce9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:43.932949 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-92aad70e-4edd-431d-b3ea-574f9f18cce9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:43.933498 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-92aad70e-4edd-431d-b3ea-574f9f18cce9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:43.934353 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-92aad70e-4edd-431d-b3ea-574f9f18cce9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:43.934821 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-92aad70e-4edd-431d-b3ea-574f9f18cce9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:44.080374 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-92aad70e-4edd-431d-b3ea-574f9f18cce9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:44.088479 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-92aad70e-4edd-431d-b3ea-574f9f18cce9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.169819 Dec 23 12:00:44.089059 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 171/319] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:43 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:44.405996 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-92138de0-75a6-4ca8-925c-f8fef518865c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 38169 microversion: 2.20 time: 3.967249 Dec 23 12:00:44.406684 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 149/320] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:40 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 38169 bytes in 3969 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:44.750280 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5354c8d6-240d-4982-b424-c2e9b269ebb4 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:44.750946 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5354c8d6-240d-4982-b424-c2e9b269ebb4 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:44.758726 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5354c8d6-240d-4982-b424-c2e9b269ebb4 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:44.759183 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5354c8d6-240d-4982-b424-c2e9b269ebb4 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:44.759968 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5354c8d6-240d-4982-b424-c2e9b269ebb4 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:44.760403 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5354c8d6-240d-4982-b424-c2e9b269ebb4 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:44.793916 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5354c8d6-240d-4982-b424-c2e9b269ebb4 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:44.794369 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5354c8d6-240d-4982-b424-c2e9b269ebb4 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:44.794873 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-5354c8d6-240d-4982-b424-c2e9b269ebb4 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lazy-loading 'fault' on Instance uuid b7549231-99ea-452a-abd4-cfd75b597880 {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:00:44.853208 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-5354c8d6-240d-4982-b424-c2e9b269ebb4 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9397ca2bd8a4195a2c54dbb1a97ddf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca5ca45c6494bff9a1a66863948f839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:44.856448 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5354c8d6-240d-4982-b424-c2e9b269ebb4 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 200 len: 1304 microversion: 2.1 time: 0.110029 Dec 23 12:00:44.857016 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 172/321] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:44 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:45.107188 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3e1a4a31-6f8b-417c-aed5-8f2cff2980c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:45.107901 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3e1a4a31-6f8b-417c-aed5-8f2cff2980c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:45.115837 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3e1a4a31-6f8b-417c-aed5-8f2cff2980c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:45.117059 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3e1a4a31-6f8b-417c-aed5-8f2cff2980c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:45.117873 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3e1a4a31-6f8b-417c-aed5-8f2cff2980c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:45.118345 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3e1a4a31-6f8b-417c-aed5-8f2cff2980c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:45.261607 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3e1a4a31-6f8b-417c-aed5-8f2cff2980c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:45.270677 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3e1a4a31-6f8b-417c-aed5-8f2cff2980c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.168513 Dec 23 12:00:45.271259 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 150/322] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:45 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:45.418023 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7bda012b-2fdb-4b0d-b0a9-4d59a79e31c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:45.418984 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-7bda012b-2fdb-4b0d-b0a9-4d59a79e31c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:45.433773 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7bda012b-2fdb-4b0d-b0a9-4d59a79e31c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:45.434229 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7bda012b-2fdb-4b0d-b0a9-4d59a79e31c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:45.435482 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7bda012b-2fdb-4b0d-b0a9-4d59a79e31c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:45.436100 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7bda012b-2fdb-4b0d-b0a9-4d59a79e31c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:45.600430 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-7bda012b-2fdb-4b0d-b0a9-4d59a79e31c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 38179 microversion: 2.20 time: 0.186100 Dec 23 12:00:45.601289 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 173/323] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:45 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 38179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:45.873125 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-054219ce-4adf-402b-9e63-a2836dc77c90 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:45.873815 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-054219ce-4adf-402b-9e63-a2836dc77c90 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] [instance: b7549231-99ea-452a-abd4-cfd75b597880] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:45.880237 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-054219ce-4adf-402b-9e63-a2836dc77c90 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:45.880905 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-054219ce-4adf-402b-9e63-a2836dc77c90 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:45.881758 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-054219ce-4adf-402b-9e63-a2836dc77c90 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:45.882542 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-054219ce-4adf-402b-9e63-a2836dc77c90 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:45.904502 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-054219ce-4adf-402b-9e63-a2836dc77c90 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] HTTP exception thrown: Instance b7549231-99ea-452a-abd4-cfd75b597880 could not be found. Dec 23 12:00:45.905098 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-054219ce-4adf-402b-9e63-a2836dc77c90 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] Returning 404 to user: Instance b7549231-99ea-452a-abd4-cfd75b597880 could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:00:45.905958 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-054219ce-4adf-402b-9e63-a2836dc77c90 tempest-VolumesActionsTest-933590312 tempest-VolumesActionsTest-933590312-project] 10.222.0.65 "GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880" status: 404 len: 111 microversion: 2.1 time: 0.036566 Dec 23 12:00:45.906525 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 151/324] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:45 2021] GET /compute/v2.1/servers/b7549231-99ea-452a-abd4-cfd75b597880 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:00:46.288853 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ad94eac4-6644-4dc8-a91a-e9edbf73d035 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:46.289722 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ad94eac4-6644-4dc8-a91a-e9edbf73d035 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:46.297041 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ad94eac4-6644-4dc8-a91a-e9edbf73d035 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:46.297501 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ad94eac4-6644-4dc8-a91a-e9edbf73d035 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:46.298298 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ad94eac4-6644-4dc8-a91a-e9edbf73d035 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:46.298759 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ad94eac4-6644-4dc8-a91a-e9edbf73d035 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:46.436718 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ad94eac4-6644-4dc8-a91a-e9edbf73d035 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:46.444327 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ad94eac4-6644-4dc8-a91a-e9edbf73d035 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.159943 Dec 23 12:00:46.445076 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 174/325] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:46 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:46.613681 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-1256603e-4760-42b5-bfd9-4e08307dd0a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:46.614807 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-1256603e-4760-42b5-bfd9-4e08307dd0a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:46.622826 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1256603e-4760-42b5-bfd9-4e08307dd0a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:46.623285 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1256603e-4760-42b5-bfd9-4e08307dd0a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:46.624077 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1256603e-4760-42b5-bfd9-4e08307dd0a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:46.624515 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1256603e-4760-42b5-bfd9-4e08307dd0a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:46.759503 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-1256603e-4760-42b5-bfd9-4e08307dd0a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 200 len: 38312 microversion: 2.20 time: 0.149515 Dec 23 12:00:46.760455 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 152/326] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:46 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 38312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:00:46.776831 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f91e043c-4d16-452d-a953-96f3594307c0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:46.777660 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f91e043c-4d16-452d-a953-96f3594307c0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:46.788818 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f91e043c-4d16-452d-a953-96f3594307c0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:46.789505 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f91e043c-4d16-452d-a953-96f3594307c0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:46.790317 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f91e043c-4d16-452d-a953-96f3594307c0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:46.790784 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f91e043c-4d16-452d-a953-96f3594307c0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:46.813822 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f91e043c-4d16-452d-a953-96f3594307c0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/ips" status: 200 len: 152 microversion: 2.20 time: 0.043731 Dec 23 12:00:46.814383 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 175/327] 10.222.0.65 () {60 vars in 1288 bytes} [Thu Dec 23 12:00:46 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:00:47.462055 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a51735cc-7795-4f49-b0d5-d2b3878a9f83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:47.462795 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a51735cc-7795-4f49-b0d5-d2b3878a9f83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:47.469931 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a51735cc-7795-4f49-b0d5-d2b3878a9f83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:47.470370 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a51735cc-7795-4f49-b0d5-d2b3878a9f83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:47.471331 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a51735cc-7795-4f49-b0d5-d2b3878a9f83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:47.471765 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a51735cc-7795-4f49-b0d5-d2b3878a9f83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:47.605126 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a51735cc-7795-4f49-b0d5-d2b3878a9f83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:47.613589 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a51735cc-7795-4f49-b0d5-d2b3878a9f83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.155901 Dec 23 12:00:47.614135 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 153/328] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:47 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:48.630710 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c5ef368c-234f-4d7f-8a03-954c949121c4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:48.631242 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c5ef368c-234f-4d7f-8a03-954c949121c4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:48.637919 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c5ef368c-234f-4d7f-8a03-954c949121c4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:48.638370 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c5ef368c-234f-4d7f-8a03-954c949121c4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:48.639163 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c5ef368c-234f-4d7f-8a03-954c949121c4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:48.639595 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c5ef368c-234f-4d7f-8a03-954c949121c4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:48.788355 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c5ef368c-234f-4d7f-8a03-954c949121c4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:48.795993 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c5ef368c-234f-4d7f-8a03-954c949121c4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.169098 Dec 23 12:00:48.796557 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 176/329] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:48 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:49.816485 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-39e8747b-c981-4459-989b-07f529aa6525 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:49.817532 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-39e8747b-c981-4459-989b-07f529aa6525 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:49.828039 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-39e8747b-c981-4459-989b-07f529aa6525 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:49.828780 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-39e8747b-c981-4459-989b-07f529aa6525 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:49.830049 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-39e8747b-c981-4459-989b-07f529aa6525 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:49.830816 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-39e8747b-c981-4459-989b-07f529aa6525 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:49.976520 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-39e8747b-c981-4459-989b-07f529aa6525 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:49.984895 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-39e8747b-c981-4459-989b-07f529aa6525 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.174434 Dec 23 12:00:49.985458 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 154/330] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:49 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:51.006713 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-fc869414-1966-4a08-bbe5-6fc7f0881175 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:51.007639 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-fc869414-1966-4a08-bbe5-6fc7f0881175 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:51.014922 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fc869414-1966-4a08-bbe5-6fc7f0881175 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:51.015381 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fc869414-1966-4a08-bbe5-6fc7f0881175 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:51.016171 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fc869414-1966-4a08-bbe5-6fc7f0881175 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:51.016608 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fc869414-1966-4a08-bbe5-6fc7f0881175 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:51.164440 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-fc869414-1966-4a08-bbe5-6fc7f0881175 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:51.172353 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-fc869414-1966-4a08-bbe5-6fc7f0881175 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.171879 Dec 23 12:00:51.172915 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 177/331] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:50 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:52.189271 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5a9b9f3f-7d83-4986-b03e-b750fc721300 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:52.189907 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5a9b9f3f-7d83-4986-b03e-b750fc721300 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:52.196401 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5a9b9f3f-7d83-4986-b03e-b750fc721300 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:52.196970 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5a9b9f3f-7d83-4986-b03e-b750fc721300 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:52.197750 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5a9b9f3f-7d83-4986-b03e-b750fc721300 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:52.198182 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5a9b9f3f-7d83-4986-b03e-b750fc721300 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:52.330747 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-5a9b9f3f-7d83-4986-b03e-b750fc721300 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:52.338331 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5a9b9f3f-7d83-4986-b03e-b750fc721300 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.152842 Dec 23 12:00:52.338913 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 155/332] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:52 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:53.357405 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0b8b29cc-29b2-4b71-a614-02c054d54259 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:53.358102 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0b8b29cc-29b2-4b71-a614-02c054d54259 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:53.365984 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0b8b29cc-29b2-4b71-a614-02c054d54259 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:53.366503 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0b8b29cc-29b2-4b71-a614-02c054d54259 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:53.367553 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0b8b29cc-29b2-4b71-a614-02c054d54259 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:53.368050 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0b8b29cc-29b2-4b71-a614-02c054d54259 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:53.503702 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0b8b29cc-29b2-4b71-a614-02c054d54259 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:53.511503 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0b8b29cc-29b2-4b71-a614-02c054d54259 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.158222 Dec 23 12:00:53.512066 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 178/333] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:53 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:54.528583 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b3d9beca-fe87-4bea-973f-8d57f1c03da2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:54.534042 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b3d9beca-fe87-4bea-973f-8d57f1c03da2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:54.543870 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b3d9beca-fe87-4bea-973f-8d57f1c03da2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:54.544457 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b3d9beca-fe87-4bea-973f-8d57f1c03da2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:54.545254 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b3d9beca-fe87-4bea-973f-8d57f1c03da2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:54.545689 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b3d9beca-fe87-4bea-973f-8d57f1c03da2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:54.704464 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b3d9beca-fe87-4bea-973f-8d57f1c03da2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:54.712608 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b3d9beca-fe87-4bea-973f-8d57f1c03da2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.187773 Dec 23 12:00:54.713170 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 156/334] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:54 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:54.732361 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-936bd78f-aa3b-4a92-b99d-f2ab1aaa7edf tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:00:54.732977 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-936bd78f-aa3b-4a92-b99d-f2ab1aaa7edf tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:54.739707 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-936bd78f-aa3b-4a92-b99d-f2ab1aaa7edf tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:54.740251 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-936bd78f-aa3b-4a92-b99d-f2ab1aaa7edf tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:54.741149 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-936bd78f-aa3b-4a92-b99d-f2ab1aaa7edf tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:54.741660 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-936bd78f-aa3b-4a92-b99d-f2ab1aaa7edf tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:54.766721 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-936bd78f-aa3b-4a92-b99d-f2ab1aaa7edf tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lazy-loading 'flavor' on Instance uuid fc998144-5288-467f-82de-9c1983559e40 {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:00:55.735336 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d44d52e7-137b-495d-81f2-00eb1b857e42 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:55.736615 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d44d52e7-137b-495d-81f2-00eb1b857e42 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:55.743726 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d44d52e7-137b-495d-81f2-00eb1b857e42 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:55.744173 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d44d52e7-137b-495d-81f2-00eb1b857e42 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:55.745035 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d44d52e7-137b-495d-81f2-00eb1b857e42 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:55.745627 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d44d52e7-137b-495d-81f2-00eb1b857e42 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:55.964205 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d44d52e7-137b-495d-81f2-00eb1b857e42 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:55.975089 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d44d52e7-137b-495d-81f2-00eb1b857e42 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.246926 Dec 23 12:00:55.975914 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 157/335] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:55 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:57.007878 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e33f64fe-79f2-45aa-9a89-019ef3d9212f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:57.007878 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e33f64fe-79f2-45aa-9a89-019ef3d9212f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:57.021285 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e33f64fe-79f2-45aa-9a89-019ef3d9212f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:57.033787 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e33f64fe-79f2-45aa-9a89-019ef3d9212f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:57.037622 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e33f64fe-79f2-45aa-9a89-019ef3d9212f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:57.038314 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e33f64fe-79f2-45aa-9a89-019ef3d9212f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:57.254863 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e33f64fe-79f2-45aa-9a89-019ef3d9212f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:57.271970 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e33f64fe-79f2-45aa-9a89-019ef3d9212f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.282919 Dec 23 12:00:57.299295 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 158/336] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:56 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:00:58.308720 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e6fd7fb5-209e-45aa-bcb1-75d8893cdd65 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:58.309445 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e6fd7fb5-209e-45aa-bcb1-75d8893cdd65 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:58.323530 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6fd7fb5-209e-45aa-bcb1-75d8893cdd65 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:58.324014 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6fd7fb5-209e-45aa-bcb1-75d8893cdd65 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:58.324839 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6fd7fb5-209e-45aa-bcb1-75d8893cdd65 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:58.325275 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6fd7fb5-209e-45aa-bcb1-75d8893cdd65 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:58.829894 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e6fd7fb5-209e-45aa-bcb1-75d8893cdd65 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:00:58.839325 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e6fd7fb5-209e-45aa-bcb1-75d8893cdd65 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.535507 Dec 23 12:00:58.839968 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 159/337] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:58 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:00:59.855749 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ba12f167-b083-43c8-8403-fffeb9583845 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:00:59.857814 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ba12f167-b083-43c8-8403-fffeb9583845 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:00:59.871298 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ba12f167-b083-43c8-8403-fffeb9583845 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:59.872046 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ba12f167-b083-43c8-8403-fffeb9583845 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:00:59.872856 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ba12f167-b083-43c8-8403-fffeb9583845 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:00:59.875675 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ba12f167-b083-43c8-8403-fffeb9583845 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:00.168574 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ba12f167-b083-43c8-8403-fffeb9583845 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:00.184858 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ba12f167-b083-43c8-8403-fffeb9583845 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.332884 Dec 23 12:01:00.205075 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 160/338] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:00:59 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:01.204684 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3ca55af1-f2eb-4b3c-b442-43dd3d8439e1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:01.205594 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3ca55af1-f2eb-4b3c-b442-43dd3d8439e1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:01.213165 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3ca55af1-f2eb-4b3c-b442-43dd3d8439e1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:01.213769 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3ca55af1-f2eb-4b3c-b442-43dd3d8439e1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:01.215297 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3ca55af1-f2eb-4b3c-b442-43dd3d8439e1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:01.215891 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3ca55af1-f2eb-4b3c-b442-43dd3d8439e1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:01.441698 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3ca55af1-f2eb-4b3c-b442-43dd3d8439e1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:01.451427 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3ca55af1-f2eb-4b3c-b442-43dd3d8439e1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.250945 Dec 23 12:01:01.452372 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 161/339] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:01 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:02.468129 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-41c2ac0f-10de-4f83-a276-399a1a543ec2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:02.469486 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-41c2ac0f-10de-4f83-a276-399a1a543ec2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:02.476172 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-41c2ac0f-10de-4f83-a276-399a1a543ec2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:02.476873 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-41c2ac0f-10de-4f83-a276-399a1a543ec2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:02.477919 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-41c2ac0f-10de-4f83-a276-399a1a543ec2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:02.478504 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-41c2ac0f-10de-4f83-a276-399a1a543ec2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:02.755488 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-41c2ac0f-10de-4f83-a276-399a1a543ec2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:02.765358 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-41c2ac0f-10de-4f83-a276-399a1a543ec2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.300215 Dec 23 12:01:02.777069 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 162/340] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:02 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:03.786904 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-23691e1c-6a97-4c3f-9ab3-1b105f35c8b4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:03.788740 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-23691e1c-6a97-4c3f-9ab3-1b105f35c8b4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:03.799170 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-23691e1c-6a97-4c3f-9ab3-1b105f35c8b4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:03.799967 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-23691e1c-6a97-4c3f-9ab3-1b105f35c8b4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:03.801552 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-23691e1c-6a97-4c3f-9ab3-1b105f35c8b4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:03.802245 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-23691e1c-6a97-4c3f-9ab3-1b105f35c8b4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:04.465176 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-23691e1c-6a97-4c3f-9ab3-1b105f35c8b4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:04.473527 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-23691e1c-6a97-4c3f-9ab3-1b105f35c8b4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.691859 Dec 23 12:01:04.479380 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 163/341] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:03 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:05.496318 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-bb998261-f28a-4956-b87c-60432f18a0fa tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:05.498207 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-bb998261-f28a-4956-b87c-60432f18a0fa tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:05.506737 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bb998261-f28a-4956-b87c-60432f18a0fa tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:05.509715 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bb998261-f28a-4956-b87c-60432f18a0fa tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:05.510819 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bb998261-f28a-4956-b87c-60432f18a0fa tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:05.511446 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bb998261-f28a-4956-b87c-60432f18a0fa tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:05.884317 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-bb998261-f28a-4956-b87c-60432f18a0fa tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:05.918115 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-bb998261-f28a-4956-b87c-60432f18a0fa tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.425678 Dec 23 12:01:05.920288 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 164/342] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:05 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:06.936583 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0144b040-7f18-411a-bc11-54332a1cdf1b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:06.937236 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0144b040-7f18-411a-bc11-54332a1cdf1b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:06.950193 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0144b040-7f18-411a-bc11-54332a1cdf1b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:06.950738 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0144b040-7f18-411a-bc11-54332a1cdf1b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:06.966015 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0144b040-7f18-411a-bc11-54332a1cdf1b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:06.966500 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0144b040-7f18-411a-bc11-54332a1cdf1b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:07.384879 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0144b040-7f18-411a-bc11-54332a1cdf1b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:07.397829 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0144b040-7f18-411a-bc11-54332a1cdf1b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.465054 Dec 23 12:01:07.404332 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 165/343] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:06 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:08.417599 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2c9d6c49-6171-4f41-b125-462d79107f64 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:08.419042 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2c9d6c49-6171-4f41-b125-462d79107f64 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:08.427120 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2c9d6c49-6171-4f41-b125-462d79107f64 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:08.427759 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2c9d6c49-6171-4f41-b125-462d79107f64 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:08.429146 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2c9d6c49-6171-4f41-b125-462d79107f64 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:08.429913 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2c9d6c49-6171-4f41-b125-462d79107f64 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:08.635863 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-2c9d6c49-6171-4f41-b125-462d79107f64 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:08.645835 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2c9d6c49-6171-4f41-b125-462d79107f64 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.232232 Dec 23 12:01:08.649731 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 166/344] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:08 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:09.436634 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4e24d0ae-40d5-40ef-8af7-905125ad1ea2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Action: 'create', calling method: .version_select at 0x7fcf28827d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1304321284"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:01:09.457923 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-4e24d0ae-40d5-40ef-8af7-905125ad1ea2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Getting quotas for project f78243e9c4ec4d51a07e39bec8a14073. Resources: {'key_pairs'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:01:09.462953 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-4e24d0ae-40d5-40ef-8af7-905125ad1ea2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Getting quotas for user 3d641a1c7e09494d86fe4a3bb88a6309 and project f78243e9c4ec4d51a07e39bec8a14073. Resources: {'key_pairs'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:01:09.730978 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-4e24d0ae-40d5-40ef-8af7-905125ad1ea2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Getting quotas for project f78243e9c4ec4d51a07e39bec8a14073. Resources: {'key_pairs'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:01:09.736201 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-4e24d0ae-40d5-40ef-8af7-905125ad1ea2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Getting quotas for user 3d641a1c7e09494d86fe4a3bb88a6309 and project f78243e9c4ec4d51a07e39bec8a14073. Resources: {'key_pairs'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:01:09.753433 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4e24d0ae-40d5-40ef-8af7-905125ad1ea2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.614568 Dec 23 12:01:09.754035 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 167/345] 10.222.0.65 () {60 vars in 1157 bytes} [Thu Dec 23 12:01:09 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:09.759127 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ebd44f03-acc1-463d-b3ba-9e3e0e04a4a4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:09.759834 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ebd44f03-acc1-463d-b3ba-9e3e0e04a4a4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:09.765699 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ebd44f03-acc1-463d-b3ba-9e3e0e04a4a4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:09.766301 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ebd44f03-acc1-463d-b3ba-9e3e0e04a4a4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:09.767292 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ebd44f03-acc1-463d-b3ba-9e3e0e04a4a4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:09.767890 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ebd44f03-acc1-463d-b3ba-9e3e0e04a4a4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:09.939230 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ebd44f03-acc1-463d-b3ba-9e3e0e04a4a4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:09.948311 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ebd44f03-acc1-463d-b3ba-9e3e0e04a4a4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.192856 Dec 23 12:01:09.949422 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 168/346] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:09 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:10.975025 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-66e08144-4987-498f-adbf-97fb5be8dad1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:10.976764 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-66e08144-4987-498f-adbf-97fb5be8dad1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:10.984926 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-66e08144-4987-498f-adbf-97fb5be8dad1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:10.986408 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-66e08144-4987-498f-adbf-97fb5be8dad1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:10.987884 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-66e08144-4987-498f-adbf-97fb5be8dad1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:10.988714 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-66e08144-4987-498f-adbf-97fb5be8dad1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:11.363797 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-66e08144-4987-498f-adbf-97fb5be8dad1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:11.378002 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-66e08144-4987-498f-adbf-97fb5be8dad1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.414813 Dec 23 12:01:11.380919 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 169/347] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:10 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:11.961963 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-936bd78f-aa3b-4a92-b99d-f2ab1aaa7edf tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 202 len: 0 microversion: 2.20 time: 17.233363 Dec 23 12:01:11.973640 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4083e1e7-d0db-42c7-a6b5-efb48fec31cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:11.974576 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4083e1e7-d0db-42c7-a6b5-efb48fec31cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:11.981271 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 179/348] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:00:54 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 0 bytes in 17254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:01:11.994189 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4083e1e7-d0db-42c7-a6b5-efb48fec31cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:11.994812 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4083e1e7-d0db-42c7-a6b5-efb48fec31cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:11.995753 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4083e1e7-d0db-42c7-a6b5-efb48fec31cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:11.996344 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4083e1e7-d0db-42c7-a6b5-efb48fec31cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:12.403933 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3c09deb6-7f38-4da2-b12a-3a60615ec0f3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:12.405012 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3c09deb6-7f38-4da2-b12a-3a60615ec0f3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:12.428794 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3c09deb6-7f38-4da2-b12a-3a60615ec0f3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:12.429355 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4083e1e7-d0db-42c7-a6b5-efb48fec31cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:12.430149 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3c09deb6-7f38-4da2-b12a-3a60615ec0f3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:12.434543 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3c09deb6-7f38-4da2-b12a-3a60615ec0f3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:12.437025 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3c09deb6-7f38-4da2-b12a-3a60615ec0f3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:12.471416 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4083e1e7-d0db-42c7-a6b5-efb48fec31cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:12.477474 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4083e1e7-d0db-42c7-a6b5-efb48fec31cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:12.478858 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4083e1e7-d0db-42c7-a6b5-efb48fec31cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.509330 Dec 23 12:01:12.490120 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 170/349] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:11 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:01:12.791761 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3c09deb6-7f38-4da2-b12a-3a60615ec0f3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:12.800844 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3c09deb6-7f38-4da2-b12a-3a60615ec0f3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.404588 Dec 23 12:01:12.801418 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 180/350] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:12 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:13.502127 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a68d6ae5-3afc-45bf-b92e-eb3c6a850abe tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:13.503593 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a68d6ae5-3afc-45bf-b92e-eb3c6a850abe tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:13.522292 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a68d6ae5-3afc-45bf-b92e-eb3c6a850abe tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:13.523113 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a68d6ae5-3afc-45bf-b92e-eb3c6a850abe tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:13.524611 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a68d6ae5-3afc-45bf-b92e-eb3c6a850abe tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:13.525538 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a68d6ae5-3afc-45bf-b92e-eb3c6a850abe tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:13.696574 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a68d6ae5-3afc-45bf-b92e-eb3c6a850abe tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:13.704513 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a68d6ae5-3afc-45bf-b92e-eb3c6a850abe tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:13.706083 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a68d6ae5-3afc-45bf-b92e-eb3c6a850abe tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:13.707700 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a68d6ae5-3afc-45bf-b92e-eb3c6a850abe tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.210371 Dec 23 12:01:13.708449 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 171/351] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:13 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:01:13.820328 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-07604f38-a686-43d5-ab8c-80f2ebdf8ac6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:13.821000 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-07604f38-a686-43d5-ab8c-80f2ebdf8ac6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:13.827471 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-07604f38-a686-43d5-ab8c-80f2ebdf8ac6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:13.827919 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-07604f38-a686-43d5-ab8c-80f2ebdf8ac6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:13.828686 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-07604f38-a686-43d5-ab8c-80f2ebdf8ac6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:13.829115 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-07604f38-a686-43d5-ab8c-80f2ebdf8ac6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:13.991331 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-07604f38-a686-43d5-ab8c-80f2ebdf8ac6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:14.012142 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-07604f38-a686-43d5-ab8c-80f2ebdf8ac6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.190087 Dec 23 12:01:14.013729 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 181/352] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:13 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:14.731578 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4e8589f9-cca2-497d-87d6-0ef6efa404bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:14.732179 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4e8589f9-cca2-497d-87d6-0ef6efa404bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:14.739888 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4e8589f9-cca2-497d-87d6-0ef6efa404bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:14.740528 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4e8589f9-cca2-497d-87d6-0ef6efa404bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:14.741330 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4e8589f9-cca2-497d-87d6-0ef6efa404bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:14.741766 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4e8589f9-cca2-497d-87d6-0ef6efa404bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:14.940789 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4e8589f9-cca2-497d-87d6-0ef6efa404bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:14.958947 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4e8589f9-cca2-497d-87d6-0ef6efa404bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:14.966429 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4e8589f9-cca2-497d-87d6-0ef6efa404bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:14.969525 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4e8589f9-cca2-497d-87d6-0ef6efa404bb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.242672 Dec 23 12:01:14.983686 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 172/353] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:14 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:15.033665 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-629148f6-8758-4e3d-9e35-9e93d8566148 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:15.034938 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-629148f6-8758-4e3d-9e35-9e93d8566148 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:15.042155 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-629148f6-8758-4e3d-9e35-9e93d8566148 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:15.042905 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-629148f6-8758-4e3d-9e35-9e93d8566148 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:15.044461 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-629148f6-8758-4e3d-9e35-9e93d8566148 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:15.045191 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-629148f6-8758-4e3d-9e35-9e93d8566148 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:15.243379 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-629148f6-8758-4e3d-9e35-9e93d8566148 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:15.255943 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-629148f6-8758-4e3d-9e35-9e93d8566148 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1502 microversion: 2.1 time: 0.226310 Dec 23 12:01:15.257300 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 182/354] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:15 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:15.277154 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-1e8ea6c1-4c4f-47fe-93b1-0670e2149142 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb899473-2d7c-46af-b2b5-35a90e17d4c6"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:01:15.278309 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-1e8ea6c1-4c4f-47fe-93b1-0670e2149142 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:15.285375 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1e8ea6c1-4c4f-47fe-93b1-0670e2149142 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:15.285832 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1e8ea6c1-4c4f-47fe-93b1-0670e2149142 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:15.286695 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1e8ea6c1-4c4f-47fe-93b1-0670e2149142 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:15.287322 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1e8ea6c1-4c4f-47fe-93b1-0670e2149142 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:15.317800 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-1e8ea6c1-4c4f-47fe-93b1-0670e2149142 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] HTTP exception thrown: Cannot 'attach_volume' instance 15f88906-0a5f-47a4-bf35-55db395a0e97 while it is in vm_state rescued Dec 23 12:01:15.318664 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-1e8ea6c1-4c4f-47fe-93b1-0670e2149142 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Returning 409 to user: Cannot 'attach_volume' instance 15f88906-0a5f-47a4-bf35-55db395a0e97 while it is in vm_state rescued {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:01:15.319538 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-1e8ea6c1-4c4f-47fe-93b1-0670e2149142 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "POST /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047345 Dec 23 12:01:15.319972 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 173/355] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Dec 23 12:01:15 2021] POST /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 23 12:01:15.336683 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e8ac7679-dbd6-47e3-a330-a1fb45639dc7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:01:15.338415 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e8ac7679-dbd6-47e3-a330-a1fb45639dc7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:15.364801 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e8ac7679-dbd6-47e3-a330-a1fb45639dc7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:15.365417 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e8ac7679-dbd6-47e3-a330-a1fb45639dc7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:15.366467 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e8ac7679-dbd6-47e3-a330-a1fb45639dc7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:15.367581 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e8ac7679-dbd6-47e3-a330-a1fb45639dc7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:15.459949 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e8ac7679-dbd6-47e3-a330-a1fb45639dc7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "POST /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/action" status: 202 len: 0 microversion: 2.1 time: 0.134072 Dec 23 12:01:15.461310 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 183/356] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:01:15 2021] POST /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:01:15.470248 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-bd801e6f-7f8c-427a-94f3-db0f4c337711 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:15.470905 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-bd801e6f-7f8c-427a-94f3-db0f4c337711 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:15.477627 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bd801e6f-7f8c-427a-94f3-db0f4c337711 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:15.478305 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bd801e6f-7f8c-427a-94f3-db0f4c337711 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:15.479364 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bd801e6f-7f8c-427a-94f3-db0f4c337711 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:15.480073 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bd801e6f-7f8c-427a-94f3-db0f4c337711 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:15.720336 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-bd801e6f-7f8c-427a-94f3-db0f4c337711 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:15.728260 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-bd801e6f-7f8c-427a-94f3-db0f4c337711 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1510 microversion: 2.1 time: 0.262862 Dec 23 12:01:15.728928 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 174/357] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:15 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1510 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:15.992119 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-163dd88c-1d2b-42c8-92f5-08c293dbb298 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:15.993055 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-163dd88c-1d2b-42c8-92f5-08c293dbb298 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:16.001351 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-163dd88c-1d2b-42c8-92f5-08c293dbb298 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:16.001878 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-163dd88c-1d2b-42c8-92f5-08c293dbb298 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:16.003045 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-163dd88c-1d2b-42c8-92f5-08c293dbb298 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:16.003541 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-163dd88c-1d2b-42c8-92f5-08c293dbb298 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:16.200606 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-163dd88c-1d2b-42c8-92f5-08c293dbb298 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:16.209409 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-163dd88c-1d2b-42c8-92f5-08c293dbb298 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:16.211312 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-163dd88c-1d2b-42c8-92f5-08c293dbb298 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:16.212496 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-163dd88c-1d2b-42c8-92f5-08c293dbb298 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.225838 Dec 23 12:01:16.213315 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 184/358] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:15 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:01:16.608118 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-15ce5dcc-eacf-4b3c-b06e-82d62c193e8e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1418775140", "imageRef": "938a78c0-341e-4043-927a-9bfe8cf52508", "flavorRef": "452", "networks": [{"uuid": "e6a08c68-4efd-455d-9eb5-a5d51e2dc856"}]}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:01:16.747022 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d9bebb11-11d5-4545-9386-9595d4441b9b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:16.747614 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d9bebb11-11d5-4545-9386-9595d4441b9b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:16.756333 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d9bebb11-11d5-4545-9386-9595d4441b9b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:16.756972 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d9bebb11-11d5-4545-9386-9595d4441b9b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:16.757869 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d9bebb11-11d5-4545-9386-9595d4441b9b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:16.759051 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d9bebb11-11d5-4545-9386-9595d4441b9b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:16.916478 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-d9bebb11-11d5-4545-9386-9595d4441b9b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:16.924157 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d9bebb11-11d5-4545-9386-9595d4441b9b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1510 microversion: 2.1 time: 0.182245 Dec 23 12:01:16.924723 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 185/359] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:16 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:17.231141 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-25c84dc5-421b-47a3-a4ed-094ae2683939 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:17.231945 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-25c84dc5-421b-47a3-a4ed-094ae2683939 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:17.240414 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-25c84dc5-421b-47a3-a4ed-094ae2683939 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:17.243031 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-25c84dc5-421b-47a3-a4ed-094ae2683939 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:17.243716 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-25c84dc5-421b-47a3-a4ed-094ae2683939 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:17.244238 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-25c84dc5-421b-47a3-a4ed-094ae2683939 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:17.385090 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-25c84dc5-421b-47a3-a4ed-094ae2683939 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:17.401249 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-25c84dc5-421b-47a3-a4ed-094ae2683939 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:17.402956 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-25c84dc5-421b-47a3-a4ed-094ae2683939 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:17.404130 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-25c84dc5-421b-47a3-a4ed-094ae2683939 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.177115 Dec 23 12:01:17.404693 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 186/360] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:17 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:17.942439 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-07a7ad0a-03fc-4d46-a7c3-42fdc2d503d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:17.943074 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-07a7ad0a-03fc-4d46-a7c3-42fdc2d503d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:17.950097 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-07a7ad0a-03fc-4d46-a7c3-42fdc2d503d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:17.950581 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-07a7ad0a-03fc-4d46-a7c3-42fdc2d503d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:17.951375 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-07a7ad0a-03fc-4d46-a7c3-42fdc2d503d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:17.952015 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-07a7ad0a-03fc-4d46-a7c3-42fdc2d503d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:18.088028 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-07a7ad0a-03fc-4d46-a7c3-42fdc2d503d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:18.096724 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-07a7ad0a-03fc-4d46-a7c3-42fdc2d503d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1510 microversion: 2.1 time: 0.157887 Dec 23 12:01:18.097475 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 187/361] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:17 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:18.423748 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c1b8c894-829e-4d1f-9719-de08277ce087 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:18.424392 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c1b8c894-829e-4d1f-9719-de08277ce087 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:18.433935 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c1b8c894-829e-4d1f-9719-de08277ce087 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:18.434481 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c1b8c894-829e-4d1f-9719-de08277ce087 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:18.435425 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c1b8c894-829e-4d1f-9719-de08277ce087 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:18.435862 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c1b8c894-829e-4d1f-9719-de08277ce087 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:18.582012 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c1b8c894-829e-4d1f-9719-de08277ce087 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:18.591057 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c1b8c894-829e-4d1f-9719-de08277ce087 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:18.592977 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c1b8c894-829e-4d1f-9719-de08277ce087 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:18.594406 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c1b8c894-829e-4d1f-9719-de08277ce087 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.175694 Dec 23 12:01:18.595185 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 188/362] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:18 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:19.113798 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-025227e0-20c3-4d78-85b2-77d03a8cc36e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:19.114414 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-025227e0-20c3-4d78-85b2-77d03a8cc36e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:19.122812 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-025227e0-20c3-4d78-85b2-77d03a8cc36e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:19.123293 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-025227e0-20c3-4d78-85b2-77d03a8cc36e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:19.124083 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-025227e0-20c3-4d78-85b2-77d03a8cc36e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:19.124522 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-025227e0-20c3-4d78-85b2-77d03a8cc36e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:19.269599 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-025227e0-20c3-4d78-85b2-77d03a8cc36e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:19.277611 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-025227e0-20c3-4d78-85b2-77d03a8cc36e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1516 microversion: 2.1 time: 0.168072 Dec 23 12:01:19.278177 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 189/363] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:19 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:19.614035 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4b672324-7ead-4de4-b6ab-cadd7a3f7fa7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:19.615018 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4b672324-7ead-4de4-b6ab-cadd7a3f7fa7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:19.622488 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4b672324-7ead-4de4-b6ab-cadd7a3f7fa7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:19.623033 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4b672324-7ead-4de4-b6ab-cadd7a3f7fa7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:19.624188 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4b672324-7ead-4de4-b6ab-cadd7a3f7fa7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:19.624616 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4b672324-7ead-4de4-b6ab-cadd7a3f7fa7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:19.772393 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4b672324-7ead-4de4-b6ab-cadd7a3f7fa7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:19.783137 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4b672324-7ead-4de4-b6ab-cadd7a3f7fa7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:19.784664 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4b672324-7ead-4de4-b6ab-cadd7a3f7fa7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:19.786346 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4b672324-7ead-4de4-b6ab-cadd7a3f7fa7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.176632 Dec 23 12:01:19.787135 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 190/364] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:19 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:01:20.635361 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2968a94e-db5a-47ac-8ce9-4dd0a940e7dd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:20.636417 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2968a94e-db5a-47ac-8ce9-4dd0a940e7dd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:20.644888 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2968a94e-db5a-47ac-8ce9-4dd0a940e7dd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:20.645239 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2968a94e-db5a-47ac-8ce9-4dd0a940e7dd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:20.646023 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2968a94e-db5a-47ac-8ce9-4dd0a940e7dd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:20.646451 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2968a94e-db5a-47ac-8ce9-4dd0a940e7dd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:20.780892 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2968a94e-db5a-47ac-8ce9-4dd0a940e7dd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:20.788700 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2968a94e-db5a-47ac-8ce9-4dd0a940e7dd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1516 microversion: 2.1 time: 0.157548 Dec 23 12:01:20.789943 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 191/365] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:20 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:20.804465 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9c33c910-7c4f-4809-b83a-bd46b03eb086 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:20.805896 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9c33c910-7c4f-4809-b83a-bd46b03eb086 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:20.811855 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9c33c910-7c4f-4809-b83a-bd46b03eb086 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:20.812399 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9c33c910-7c4f-4809-b83a-bd46b03eb086 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:20.813284 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9c33c910-7c4f-4809-b83a-bd46b03eb086 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:20.813801 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9c33c910-7c4f-4809-b83a-bd46b03eb086 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:20.974926 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9c33c910-7c4f-4809-b83a-bd46b03eb086 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:20.984708 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9c33c910-7c4f-4809-b83a-bd46b03eb086 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:20.988121 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9c33c910-7c4f-4809-b83a-bd46b03eb086 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:20.988308 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9c33c910-7c4f-4809-b83a-bd46b03eb086 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.187476 Dec 23 12:01:20.998840 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 192/366] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:20 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:21.011557 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e2620129-7f33-46dd-8f08-e797c7c4d548 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5a4d92b-0574-49e0-b118-6628ec8c9267"}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:01:21.012733 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e2620129-7f33-46dd-8f08-e797c7c4d548 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:21.024998 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2620129-7f33-46dd-8f08-e797c7c4d548 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:21.025551 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2620129-7f33-46dd-8f08-e797c7c4d548 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:21.026469 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2620129-7f33-46dd-8f08-e797c7c4d548 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:21.027009 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2620129-7f33-46dd-8f08-e797c7c4d548 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:21.393835 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e2620129-7f33-46dd-8f08-e797c7c4d548 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "POST /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402452 Dec 23 12:01:21.394892 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 193/367] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Dec 23 12:01:20 2021] POST /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/os-volume_attachments => generated 194 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:01:22.007310 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1946f196-d112-4af7-9628-a6beade9c8eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:22.008094 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1946f196-d112-4af7-9628-a6beade9c8eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:22.018088 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1946f196-d112-4af7-9628-a6beade9c8eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:22.018593 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1946f196-d112-4af7-9628-a6beade9c8eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:22.019703 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1946f196-d112-4af7-9628-a6beade9c8eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:22.020274 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1946f196-d112-4af7-9628-a6beade9c8eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:22.154931 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1946f196-d112-4af7-9628-a6beade9c8eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:22.162958 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1946f196-d112-4af7-9628-a6beade9c8eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:22.164718 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1946f196-d112-4af7-9628-a6beade9c8eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:22.165874 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1946f196-d112-4af7-9628-a6beade9c8eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.162827 Dec 23 12:01:22.166440 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 194/368] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:22 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:23.184275 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-93d4dfac-c217-4f85-868c-b0ca7b280258 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:23.185126 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-93d4dfac-c217-4f85-868c-b0ca7b280258 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:23.192481 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-93d4dfac-c217-4f85-868c-b0ca7b280258 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:23.193522 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-93d4dfac-c217-4f85-868c-b0ca7b280258 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:23.194426 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-93d4dfac-c217-4f85-868c-b0ca7b280258 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:23.195219 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-93d4dfac-c217-4f85-868c-b0ca7b280258 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:23.329357 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-93d4dfac-c217-4f85-868c-b0ca7b280258 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:23.337357 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-93d4dfac-c217-4f85-868c-b0ca7b280258 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:23.339109 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-93d4dfac-c217-4f85-868c-b0ca7b280258 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:23.340790 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-93d4dfac-c217-4f85-868c-b0ca7b280258 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.160514 Dec 23 12:01:23.341366 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 195/369] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:23 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:01:24.361742 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-76de0a19-626c-48f7-81f1-1d37c2584fbc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:24.362574 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-76de0a19-626c-48f7-81f1-1d37c2584fbc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:24.371308 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-76de0a19-626c-48f7-81f1-1d37c2584fbc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:24.372140 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-76de0a19-626c-48f7-81f1-1d37c2584fbc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:24.372960 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-76de0a19-626c-48f7-81f1-1d37c2584fbc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:24.373385 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-76de0a19-626c-48f7-81f1-1d37c2584fbc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:24.520550 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-76de0a19-626c-48f7-81f1-1d37c2584fbc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:24.529292 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-76de0a19-626c-48f7-81f1-1d37c2584fbc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:24.531107 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-76de0a19-626c-48f7-81f1-1d37c2584fbc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:24.532275 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-76de0a19-626c-48f7-81f1-1d37c2584fbc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.176357 Dec 23 12:01:24.533165 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 196/370] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:24 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:25.552157 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c9af89fd-3af5-4120-94d5-c37dc6787dca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:25.552828 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c9af89fd-3af5-4120-94d5-c37dc6787dca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:25.559804 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c9af89fd-3af5-4120-94d5-c37dc6787dca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:25.560375 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c9af89fd-3af5-4120-94d5-c37dc6787dca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:25.561266 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c9af89fd-3af5-4120-94d5-c37dc6787dca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:25.561777 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c9af89fd-3af5-4120-94d5-c37dc6787dca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:25.705315 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c9af89fd-3af5-4120-94d5-c37dc6787dca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:25.713359 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c9af89fd-3af5-4120-94d5-c37dc6787dca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:25.714868 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c9af89fd-3af5-4120-94d5-c37dc6787dca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:25.716144 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c9af89fd-3af5-4120-94d5-c37dc6787dca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.168477 Dec 23 12:01:25.716875 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 197/371] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:25 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:26.734137 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-079e606b-2960-4b03-b6d7-f638d9b3f5bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:26.735032 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-079e606b-2960-4b03-b6d7-f638d9b3f5bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:26.742812 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-079e606b-2960-4b03-b6d7-f638d9b3f5bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:26.743269 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-079e606b-2960-4b03-b6d7-f638d9b3f5bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:26.744329 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-079e606b-2960-4b03-b6d7-f638d9b3f5bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:26.744766 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-079e606b-2960-4b03-b6d7-f638d9b3f5bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:26.893001 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-079e606b-2960-4b03-b6d7-f638d9b3f5bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:26.901778 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-079e606b-2960-4b03-b6d7-f638d9b3f5bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:26.903183 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-079e606b-2960-4b03-b6d7-f638d9b3f5bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:26.904349 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-079e606b-2960-4b03-b6d7-f638d9b3f5bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.174717 Dec 23 12:01:26.904913 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 198/372] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:26 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:01:27.922683 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f245eff3-6f07-4bf1-9e51-65b817f352af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:27.923460 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f245eff3-6f07-4bf1-9e51-65b817f352af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:27.930834 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f245eff3-6f07-4bf1-9e51-65b817f352af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:27.931370 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f245eff3-6f07-4bf1-9e51-65b817f352af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:27.932495 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f245eff3-6f07-4bf1-9e51-65b817f352af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:27.933008 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f245eff3-6f07-4bf1-9e51-65b817f352af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:28.069183 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f245eff3-6f07-4bf1-9e51-65b817f352af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:28.077822 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f245eff3-6f07-4bf1-9e51-65b817f352af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:28.079358 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f245eff3-6f07-4bf1-9e51-65b817f352af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:28.080605 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f245eff3-6f07-4bf1-9e51-65b817f352af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.161966 Dec 23 12:01:28.082564 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 199/373] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:27 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:29.099426 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-73a2db4e-d4fb-4a0d-9e1d-e48012dd9d79 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:29.100243 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-73a2db4e-d4fb-4a0d-9e1d-e48012dd9d79 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:29.106790 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-73a2db4e-d4fb-4a0d-9e1d-e48012dd9d79 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:29.107290 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-73a2db4e-d4fb-4a0d-9e1d-e48012dd9d79 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:29.108072 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-73a2db4e-d4fb-4a0d-9e1d-e48012dd9d79 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:29.108505 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-73a2db4e-d4fb-4a0d-9e1d-e48012dd9d79 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:29.243282 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-73a2db4e-d4fb-4a0d-9e1d-e48012dd9d79 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:29.252084 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-73a2db4e-d4fb-4a0d-9e1d-e48012dd9d79 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:29.255279 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-73a2db4e-d4fb-4a0d-9e1d-e48012dd9d79 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:29.255826 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-73a2db4e-d4fb-4a0d-9e1d-e48012dd9d79 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1746 microversion: 2.20 time: 0.159782 Dec 23 12:01:29.260439 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 200/374] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:29 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:01:29.948792 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f412c7c0-6406-4808-8e09-de40684990c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:01:29.950012 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f412c7c0-6406-4808-8e09-de40684990c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:29.956211 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f412c7c0-6406-4808-8e09-de40684990c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:29.956675 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f412c7c0-6406-4808-8e09-de40684990c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:29.957461 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f412c7c0-6406-4808-8e09-de40684990c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:29.957888 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f412c7c0-6406-4808-8e09-de40684990c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:29.981183 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-f412c7c0-6406-4808-8e09-de40684990c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lazy-loading 'flavor' on Instance uuid 15f88906-0a5f-47a4-bf35-55db395a0e97 {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:01:30.105101 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f412c7c0-6406-4808-8e09-de40684990c2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "POST /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/action" status: 200 len: 32 microversion: 2.1 time: 0.160510 Dec 23 12:01:30.110126 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 201/375] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:01:29 2021] POST /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 23 12:01:30.117157 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7e50beba-4800-460f-badd-6d17bfc3f398 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:30.117955 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-7e50beba-4800-460f-badd-6d17bfc3f398 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:30.124842 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7e50beba-4800-460f-badd-6d17bfc3f398 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:30.125440 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7e50beba-4800-460f-badd-6d17bfc3f398 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:30.126402 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7e50beba-4800-460f-badd-6d17bfc3f398 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:30.126862 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7e50beba-4800-460f-badd-6d17bfc3f398 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:30.305811 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-7e50beba-4800-460f-badd-6d17bfc3f398 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:30.313911 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-7e50beba-4800-460f-badd-6d17bfc3f398 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.202077 Dec 23 12:01:30.314474 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 202/376] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:30 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:30.319033 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-467c1646-85a8-4288-b1cf-ef46949b7482 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:30.319852 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-467c1646-85a8-4288-b1cf-ef46949b7482 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:30.325651 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-467c1646-85a8-4288-b1cf-ef46949b7482 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:30.326101 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-467c1646-85a8-4288-b1cf-ef46949b7482 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:30.326915 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-467c1646-85a8-4288-b1cf-ef46949b7482 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:30.327506 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-467c1646-85a8-4288-b1cf-ef46949b7482 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:30.584909 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-467c1646-85a8-4288-b1cf-ef46949b7482 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:30.598588 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-467c1646-85a8-4288-b1cf-ef46949b7482 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:30.600768 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-467c1646-85a8-4288-b1cf-ef46949b7482 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:30.602201 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-467c1646-85a8-4288-b1cf-ef46949b7482 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1746 microversion: 2.20 time: 0.286633 Dec 23 12:01:30.604569 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 203/377] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:30 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1746 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:31.331272 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-190170e1-ceca-4b9e-9db3-aa82b07aa5e0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:31.331983 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-190170e1-ceca-4b9e-9db3-aa82b07aa5e0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:31.338663 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-190170e1-ceca-4b9e-9db3-aa82b07aa5e0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:31.339104 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-190170e1-ceca-4b9e-9db3-aa82b07aa5e0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:31.339899 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-190170e1-ceca-4b9e-9db3-aa82b07aa5e0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:31.340508 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-190170e1-ceca-4b9e-9db3-aa82b07aa5e0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:31.493668 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-190170e1-ceca-4b9e-9db3-aa82b07aa5e0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:31.507891 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-190170e1-ceca-4b9e-9db3-aa82b07aa5e0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.180440 Dec 23 12:01:31.508734 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 204/378] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:31 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:31.621987 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-076d9bfa-b3eb-4d43-844d-731d74f64554 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:31.622918 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-076d9bfa-b3eb-4d43-844d-731d74f64554 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:31.629350 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-076d9bfa-b3eb-4d43-844d-731d74f64554 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:31.630034 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-076d9bfa-b3eb-4d43-844d-731d74f64554 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:31.631085 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-076d9bfa-b3eb-4d43-844d-731d74f64554 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:31.631695 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-076d9bfa-b3eb-4d43-844d-731d74f64554 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:31.770719 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-076d9bfa-b3eb-4d43-844d-731d74f64554 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:31.779821 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-076d9bfa-b3eb-4d43-844d-731d74f64554 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:31.781313 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-076d9bfa-b3eb-4d43-844d-731d74f64554 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:31.782480 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-076d9bfa-b3eb-4d43-844d-731d74f64554 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1741 microversion: 2.20 time: 0.164640 Dec 23 12:01:31.783077 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 205/379] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:31 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:32.526992 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-79c670a1-3a31-4eaa-bc01-df8d0ada0e2c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:32.529003 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-79c670a1-3a31-4eaa-bc01-df8d0ada0e2c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:32.537578 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-79c670a1-3a31-4eaa-bc01-df8d0ada0e2c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:32.540856 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-79c670a1-3a31-4eaa-bc01-df8d0ada0e2c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:32.541803 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-79c670a1-3a31-4eaa-bc01-df8d0ada0e2c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:32.543011 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-79c670a1-3a31-4eaa-bc01-df8d0ada0e2c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:32.732411 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-79c670a1-3a31-4eaa-bc01-df8d0ada0e2c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:32.742080 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-79c670a1-3a31-4eaa-bc01-df8d0ada0e2c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.220146 Dec 23 12:01:32.743246 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 206/380] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:32 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:32.748272 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-349221a1-4cd6-471c-983d-9c4c846b9889 req-137604f8-00db-4393-b4f7-54b86f9e474b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc998144-5288-467f-82de-9c1983559e40", "name": "network-vif-plugged", "status": "completed", "tag": "bbf34ca1-ab1a-4521-9402-ff6d335fe55a"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:01:32.749888 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:01:32.749888 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:01:32.757074 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-349221a1-4cd6-471c-983d-9c4c846b9889 req-137604f8-00db-4393-b4f7-54b86f9e474b service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:32.757552 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-349221a1-4cd6-471c-983d-9c4c846b9889 req-137604f8-00db-4393-b4f7-54b86f9e474b service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:32.768702 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-349221a1-4cd6-471c-983d-9c4c846b9889 req-137604f8-00db-4393-b4f7-54b86f9e474b service nova] Creating event network-vif-plugged:bbf34ca1-ab1a-4521-9402-ff6d335fe55a for instance fc998144-5288-467f-82de-9c1983559e40 on hv-cinder-82282 Dec 23 12:01:32.775482 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-349221a1-4cd6-471c-983d-9c4c846b9889 req-137604f8-00db-4393-b4f7-54b86f9e474b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030745 Dec 23 12:01:32.776220 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 207/381] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:01:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:01:32.802873 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-99875531-7519-495c-8cf5-725a67139468 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:32.803811 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-99875531-7519-495c-8cf5-725a67139468 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:32.810242 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-99875531-7519-495c-8cf5-725a67139468 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:32.810718 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-99875531-7519-495c-8cf5-725a67139468 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:32.811487 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-99875531-7519-495c-8cf5-725a67139468 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:32.811914 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-99875531-7519-495c-8cf5-725a67139468 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:32.972404 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-99875531-7519-495c-8cf5-725a67139468 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:32.980325 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-99875531-7519-495c-8cf5-725a67139468 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:32.981803 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-99875531-7519-495c-8cf5-725a67139468 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:32.982983 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-99875531-7519-495c-8cf5-725a67139468 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1741 microversion: 2.20 time: 0.184396 Dec 23 12:01:32.983534 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 208/382] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:32 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:01:33.761377 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e91773e4-1387-4faa-8d7d-0a793be5e7e5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:33.762164 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e91773e4-1387-4faa-8d7d-0a793be5e7e5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:33.769161 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e91773e4-1387-4faa-8d7d-0a793be5e7e5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:33.769609 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e91773e4-1387-4faa-8d7d-0a793be5e7e5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:33.770402 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e91773e4-1387-4faa-8d7d-0a793be5e7e5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:33.770980 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e91773e4-1387-4faa-8d7d-0a793be5e7e5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:33.907285 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e91773e4-1387-4faa-8d7d-0a793be5e7e5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:33.916606 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e91773e4-1387-4faa-8d7d-0a793be5e7e5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.158988 Dec 23 12:01:33.919736 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 209/383] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:33 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:34.002224 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9138a409-3394-404b-913b-f6f2f1b32dcc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:34.002880 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9138a409-3394-404b-913b-f6f2f1b32dcc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:34.009980 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9138a409-3394-404b-913b-f6f2f1b32dcc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:34.010440 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9138a409-3394-404b-913b-f6f2f1b32dcc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:34.011315 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9138a409-3394-404b-913b-f6f2f1b32dcc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:34.011892 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9138a409-3394-404b-913b-f6f2f1b32dcc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:34.153064 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9138a409-3394-404b-913b-f6f2f1b32dcc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:34.161312 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9138a409-3394-404b-913b-f6f2f1b32dcc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:34.162947 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9138a409-3394-404b-913b-f6f2f1b32dcc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:34.164107 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9138a409-3394-404b-913b-f6f2f1b32dcc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1741 microversion: 2.20 time: 0.166218 Dec 23 12:01:34.164697 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 210/384] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:33 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:34.935067 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-09e441c8-94a1-44d2-bcf7-9a6560d93a95 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:34.935720 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-09e441c8-94a1-44d2-bcf7-9a6560d93a95 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:34.942311 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-09e441c8-94a1-44d2-bcf7-9a6560d93a95 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:34.942821 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-09e441c8-94a1-44d2-bcf7-9a6560d93a95 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:34.943614 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-09e441c8-94a1-44d2-bcf7-9a6560d93a95 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:34.944055 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-09e441c8-94a1-44d2-bcf7-9a6560d93a95 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:35.091988 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-09e441c8-94a1-44d2-bcf7-9a6560d93a95 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:35.100542 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-09e441c8-94a1-44d2-bcf7-9a6560d93a95 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.169371 Dec 23 12:01:35.101523 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 211/385] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:34 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:35.182344 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c9fc70ed-a5ce-4bd3-941b-2f8cc172a791 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:35.183061 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c9fc70ed-a5ce-4bd3-941b-2f8cc172a791 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:35.189891 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c9fc70ed-a5ce-4bd3-941b-2f8cc172a791 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:35.190265 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c9fc70ed-a5ce-4bd3-941b-2f8cc172a791 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:35.191114 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c9fc70ed-a5ce-4bd3-941b-2f8cc172a791 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:35.191571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c9fc70ed-a5ce-4bd3-941b-2f8cc172a791 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:35.328565 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c9fc70ed-a5ce-4bd3-941b-2f8cc172a791 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:35.347959 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c9fc70ed-a5ce-4bd3-941b-2f8cc172a791 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:35.349905 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c9fc70ed-a5ce-4bd3-941b-2f8cc172a791 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:35.351506 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c9fc70ed-a5ce-4bd3-941b-2f8cc172a791 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1741 microversion: 2.20 time: 0.173931 Dec 23 12:01:35.362591 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 212/386] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:35 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:01:36.118432 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5b4bf6cc-6b20-42cd-a246-f470894d675d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:36.119151 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5b4bf6cc-6b20-42cd-a246-f470894d675d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:36.125605 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5b4bf6cc-6b20-42cd-a246-f470894d675d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:36.126073 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5b4bf6cc-6b20-42cd-a246-f470894d675d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:36.126871 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5b4bf6cc-6b20-42cd-a246-f470894d675d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:36.127311 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5b4bf6cc-6b20-42cd-a246-f470894d675d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:36.280992 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-5b4bf6cc-6b20-42cd-a246-f470894d675d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:36.289199 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5b4bf6cc-6b20-42cd-a246-f470894d675d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.174610 Dec 23 12:01:36.289839 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 213/387] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:36 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:36.376567 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-becfcadb-6f5e-434e-b016-c0bee7174296 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:36.377887 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-becfcadb-6f5e-434e-b016-c0bee7174296 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:36.384841 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-becfcadb-6f5e-434e-b016-c0bee7174296 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:36.385408 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-becfcadb-6f5e-434e-b016-c0bee7174296 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:36.386276 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-becfcadb-6f5e-434e-b016-c0bee7174296 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:36.386800 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-becfcadb-6f5e-434e-b016-c0bee7174296 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:36.530391 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-becfcadb-6f5e-434e-b016-c0bee7174296 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:36.539455 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-becfcadb-6f5e-434e-b016-c0bee7174296 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:36.541940 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-becfcadb-6f5e-434e-b016-c0bee7174296 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:36.543437 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-becfcadb-6f5e-434e-b016-c0bee7174296 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1741 microversion: 2.20 time: 0.171207 Dec 23 12:01:36.543999 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 214/388] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:36 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:37.247324 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.network.neutron [None req-15ce5dcc-eacf-4b3c-b06e-82d62c193e8e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] validate_networks() for [('e6a08c68-4efd-455d-9eb5-a5d51e2dc856', None, None, None, None, None)] {{(pid=116355) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 12:01:37.306401 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4d1a854f-b0da-42b2-bb4b-7419864e1b85 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:37.307046 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4d1a854f-b0da-42b2-bb4b-7419864e1b85 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:37.313602 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4d1a854f-b0da-42b2-bb4b-7419864e1b85 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:37.314009 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4d1a854f-b0da-42b2-bb4b-7419864e1b85 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:37.314827 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4d1a854f-b0da-42b2-bb4b-7419864e1b85 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:37.315267 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4d1a854f-b0da-42b2-bb4b-7419864e1b85 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:37.546941 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4d1a854f-b0da-42b2-bb4b-7419864e1b85 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:37.555382 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4d1a854f-b0da-42b2-bb4b-7419864e1b85 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.252640 Dec 23 12:01:37.557002 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 215/389] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:37 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:37.561918 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-6404f000-8ccb-4994-9ad5-fbe2884fe423 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:37.562549 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-6404f000-8ccb-4994-9ad5-fbe2884fe423 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:37.573645 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6404f000-8ccb-4994-9ad5-fbe2884fe423 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:37.574145 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6404f000-8ccb-4994-9ad5-fbe2884fe423 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:37.575536 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6404f000-8ccb-4994-9ad5-fbe2884fe423 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:37.576061 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6404f000-8ccb-4994-9ad5-fbe2884fe423 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:37.715720 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-15ce5dcc-eacf-4b3c-b06e-82d62c193e8e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Flavor limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 12:01:37.716439 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-15ce5dcc-eacf-4b3c-b06e-82d62c193e8e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Image limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 12:01:37.717024 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-15ce5dcc-eacf-4b3c-b06e-82d62c193e8e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Flavor pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 12:01:37.717562 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-15ce5dcc-eacf-4b3c-b06e-82d62c193e8e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Image pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 12:01:37.718070 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-15ce5dcc-eacf-4b3c-b06e-82d62c193e8e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 12:01:37.727955 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-15ce5dcc-eacf-4b3c-b06e-82d62c193e8e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:37.728710 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-15ce5dcc-eacf-4b3c-b06e-82d62c193e8e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:37.729761 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-15ce5dcc-eacf-4b3c-b06e-82d62c193e8e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:37.730433 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-15ce5dcc-eacf-4b3c-b06e-82d62c193e8e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:37.750134 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-15ce5dcc-eacf-4b3c-b06e-82d62c193e8e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Getting quotas for project 656fb5fa69a64dd49ed36532dfa2ef18. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:01:37.753470 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-15ce5dcc-eacf-4b3c-b06e-82d62c193e8e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Getting quotas for user 26fed87e1ecb47478db1cffa6d53f416 and project 656fb5fa69a64dd49ed36532dfa2ef18. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:01:37.759196 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-6404f000-8ccb-4994-9ad5-fbe2884fe423 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:37.765140 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-15ce5dcc-eacf-4b3c-b06e-82d62c193e8e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Going to run 1 instances... {{(pid=116355) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 12:01:37.767671 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-15ce5dcc-eacf-4b3c-b06e-82d62c193e8e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='938a78c0-341e-4043-927a-9bfe8cf52508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 12:01:37.768240 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-6404f000-8ccb-4994-9ad5-fbe2884fe423 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:37.769734 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-6404f000-8ccb-4994-9ad5-fbe2884fe423 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:37.771003 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-6404f000-8ccb-4994-9ad5-fbe2884fe423 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1741 microversion: 2.20 time: 0.212668 Dec 23 12:01:37.771518 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 216/390] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:37 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:37.821483 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-15ce5dcc-eacf-4b3c-b06e-82d62c193e8e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 21.219219 Dec 23 12:01:37.822724 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 175/391] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 12:01:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 21221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 12:01:37.831974 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f9f4a503-db21-41fa-9671-c6b95f68a36b tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:37.832529 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f9f4a503-db21-41fa-9671-c6b95f68a36b tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:37.889886 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f9f4a503-db21-41fa-9671-c6b95f68a36b tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:37.897139 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f9f4a503-db21-41fa-9671-c6b95f68a36b tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1219 microversion: 2.1 time: 0.068768 Dec 23 12:01:37.898262 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 217/392] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:37 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:38.574721 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-fb75c8d8-983a-4518-81eb-0a4312addf61 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:38.575485 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-fb75c8d8-983a-4518-81eb-0a4312addf61 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:38.581798 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fb75c8d8-983a-4518-81eb-0a4312addf61 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:38.582330 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fb75c8d8-983a-4518-81eb-0a4312addf61 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:38.583306 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fb75c8d8-983a-4518-81eb-0a4312addf61 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:38.583803 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fb75c8d8-983a-4518-81eb-0a4312addf61 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:38.747992 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-fb75c8d8-983a-4518-81eb-0a4312addf61 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:38.757299 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-fb75c8d8-983a-4518-81eb-0a4312addf61 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.187944 Dec 23 12:01:38.757876 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 176/393] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:38 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:38.788998 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-331cee85-111b-46e1-b2c9-cc2f02588e1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:38.789863 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-331cee85-111b-46e1-b2c9-cc2f02588e1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:38.802359 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-331cee85-111b-46e1-b2c9-cc2f02588e1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:38.802843 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-331cee85-111b-46e1-b2c9-cc2f02588e1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:38.803658 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-331cee85-111b-46e1-b2c9-cc2f02588e1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:38.804099 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-331cee85-111b-46e1-b2c9-cc2f02588e1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:38.916684 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c8e89de3-8fe5-4bc2-8eb3-249928a54a72 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:38.917480 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c8e89de3-8fe5-4bc2-8eb3-249928a54a72 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:39.041185 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c8e89de3-8fe5-4bc2-8eb3-249928a54a72 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:39.050245 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c8e89de3-8fe5-4bc2-8eb3-249928a54a72 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1219 microversion: 2.1 time: 0.138740 Dec 23 12:01:39.050764 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 177/394] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:38 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:39.135997 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-331cee85-111b-46e1-b2c9-cc2f02588e1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:39.149078 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-331cee85-111b-46e1-b2c9-cc2f02588e1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:39.150769 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-331cee85-111b-46e1-b2c9-cc2f02588e1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:39.151911 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-331cee85-111b-46e1-b2c9-cc2f02588e1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1741 microversion: 2.20 time: 0.366643 Dec 23 12:01:39.162201 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 218/395] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:38 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1741 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:39.777296 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8a083a16-145b-47ea-bdcf-c4af89aaa9aa tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:39.778086 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-8a083a16-145b-47ea-bdcf-c4af89aaa9aa tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:39.791006 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8a083a16-145b-47ea-bdcf-c4af89aaa9aa tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:39.791614 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8a083a16-145b-47ea-bdcf-c4af89aaa9aa tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:39.794699 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8a083a16-145b-47ea-bdcf-c4af89aaa9aa tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:39.797028 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8a083a16-145b-47ea-bdcf-c4af89aaa9aa tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:39.967361 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-8a083a16-145b-47ea-bdcf-c4af89aaa9aa tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:39.976997 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-8a083a16-145b-47ea-bdcf-c4af89aaa9aa tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.206437 Dec 23 12:01:39.988102 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 178/396] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:39 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:40.066922 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-aef1edbe-d029-4a27-ba31-ff3a9ff90927 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:40.068043 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-aef1edbe-d029-4a27-ba31-ff3a9ff90927 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:40.133099 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-aef1edbe-d029-4a27-ba31-ff3a9ff90927 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:40.140550 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-aef1edbe-d029-4a27-ba31-ff3a9ff90927 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1219 microversion: 2.1 time: 0.077300 Dec 23 12:01:40.141349 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 219/397] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:40 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:40.170280 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4c241935-f5db-4277-ade8-5a8a185bc26b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:40.172224 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4c241935-f5db-4277-ade8-5a8a185bc26b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:40.192036 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4c241935-f5db-4277-ade8-5a8a185bc26b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:40.192788 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4c241935-f5db-4277-ade8-5a8a185bc26b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:40.193837 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4c241935-f5db-4277-ade8-5a8a185bc26b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:40.194669 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4c241935-f5db-4277-ade8-5a8a185bc26b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:40.353782 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4c241935-f5db-4277-ade8-5a8a185bc26b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:40.366251 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4c241935-f5db-4277-ade8-5a8a185bc26b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:40.367977 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4c241935-f5db-4277-ade8-5a8a185bc26b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:40.369205 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4c241935-f5db-4277-ade8-5a8a185bc26b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1741 microversion: 2.20 time: 0.202958 Dec 23 12:01:40.369779 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 179/398] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:40 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:40.995536 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-11639b3c-5a13-4f16-b641-346636335b89 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:40.996500 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-11639b3c-5a13-4f16-b641-346636335b89 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:41.003568 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-11639b3c-5a13-4f16-b641-346636335b89 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:41.004258 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-11639b3c-5a13-4f16-b641-346636335b89 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:41.005581 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-11639b3c-5a13-4f16-b641-346636335b89 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:41.006180 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-11639b3c-5a13-4f16-b641-346636335b89 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:41.160906 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-9684abcd-f5ff-4d72-80ab-ea366cc163cf tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:41.160906 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-9684abcd-f5ff-4d72-80ab-ea366cc163cf tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:41.295604 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-9684abcd-f5ff-4d72-80ab-ea366cc163cf tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:41.305966 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-11639b3c-5a13-4f16-b641-346636335b89 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:41.350021 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-11639b3c-5a13-4f16-b641-346636335b89 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.357008 Dec 23 12:01:41.350918 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-9684abcd-f5ff-4d72-80ab-ea366cc163cf tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1219 microversion: 2.1 time: 0.194993 Dec 23 12:01:41.359048 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 180/399] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:41 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1219 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:41.371458 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 220/400] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:40 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:41.392595 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4c271af4-edcf-4453-8e32-3ea131a2e5a3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:41.393655 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4c271af4-edcf-4453-8e32-3ea131a2e5a3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:41.411092 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4c271af4-edcf-4453-8e32-3ea131a2e5a3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:41.418256 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4c271af4-edcf-4453-8e32-3ea131a2e5a3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:41.419143 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4c271af4-edcf-4453-8e32-3ea131a2e5a3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:41.419757 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4c271af4-edcf-4453-8e32-3ea131a2e5a3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:41.614234 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4c271af4-edcf-4453-8e32-3ea131a2e5a3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:41.623555 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4c271af4-edcf-4453-8e32-3ea131a2e5a3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:41.625313 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4c271af4-edcf-4453-8e32-3ea131a2e5a3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:41.626704 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4c271af4-edcf-4453-8e32-3ea131a2e5a3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1741 microversion: 2.20 time: 0.241759 Dec 23 12:01:41.632398 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 181/401] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:41 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1741 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:42.377251 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ef1984e5-ddaf-4cc3-aa48-c928347ebe7d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:42.377913 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f01e43fe-20d7-4671-9e7c-742cb5b5ce0e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:42.377913 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f01e43fe-20d7-4671-9e7c-742cb5b5ce0e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:42.378387 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ef1984e5-ddaf-4cc3-aa48-c928347ebe7d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:42.385539 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ef1984e5-ddaf-4cc3-aa48-c928347ebe7d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:42.385760 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f01e43fe-20d7-4671-9e7c-742cb5b5ce0e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:42.386243 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f01e43fe-20d7-4671-9e7c-742cb5b5ce0e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:42.386850 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ef1984e5-ddaf-4cc3-aa48-c928347ebe7d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:42.387270 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f01e43fe-20d7-4671-9e7c-742cb5b5ce0e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:42.387763 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f01e43fe-20d7-4671-9e7c-742cb5b5ce0e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:42.388277 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ef1984e5-ddaf-4cc3-aa48-c928347ebe7d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:42.388904 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ef1984e5-ddaf-4cc3-aa48-c928347ebe7d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:42.502188 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f01e43fe-20d7-4671-9e7c-742cb5b5ce0e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:42.511113 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f01e43fe-20d7-4671-9e7c-742cb5b5ce0e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1223 microversion: 2.1 time: 0.137541 Dec 23 12:01:42.513448 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 221/402] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:42 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1223 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:42.593411 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ef1984e5-ddaf-4cc3-aa48-c928347ebe7d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:42.605666 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ef1984e5-ddaf-4cc3-aa48-c928347ebe7d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.232045 Dec 23 12:01:42.606677 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 182/403] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:42 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:42.645527 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f531ae67-d211-4ac9-b832-264e6bf4d1ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:42.646403 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f531ae67-d211-4ac9-b832-264e6bf4d1ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:42.653035 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f531ae67-d211-4ac9-b832-264e6bf4d1ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:42.654338 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f531ae67-d211-4ac9-b832-264e6bf4d1ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:42.655170 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f531ae67-d211-4ac9-b832-264e6bf4d1ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:42.655769 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f531ae67-d211-4ac9-b832-264e6bf4d1ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:42.795408 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f531ae67-d211-4ac9-b832-264e6bf4d1ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:42.803995 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f531ae67-d211-4ac9-b832-264e6bf4d1ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:42.805637 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f531ae67-d211-4ac9-b832-264e6bf4d1ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:42.807668 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f531ae67-d211-4ac9-b832-264e6bf4d1ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1741 microversion: 2.20 time: 0.166103 Dec 23 12:01:42.808315 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 222/404] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:42 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:43.529366 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b17ac5dd-2d0d-4bf2-a3c1-d0ccd1de4256 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:43.530193 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b17ac5dd-2d0d-4bf2-a3c1-d0ccd1de4256 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:43.537086 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b17ac5dd-2d0d-4bf2-a3c1-d0ccd1de4256 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:43.539594 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b17ac5dd-2d0d-4bf2-a3c1-d0ccd1de4256 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:43.541112 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b17ac5dd-2d0d-4bf2-a3c1-d0ccd1de4256 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:43.542144 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b17ac5dd-2d0d-4bf2-a3c1-d0ccd1de4256 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:43.623560 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b17ac5dd-2d0d-4bf2-a3c1-d0ccd1de4256 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:43.626382 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d3bb5cc9-3f2f-4841-b23e-c610a8dd59d5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:43.627809 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d3bb5cc9-3f2f-4841-b23e-c610a8dd59d5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:43.636571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d3bb5cc9-3f2f-4841-b23e-c610a8dd59d5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:43.638395 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d3bb5cc9-3f2f-4841-b23e-c610a8dd59d5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:43.639634 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d3bb5cc9-3f2f-4841-b23e-c610a8dd59d5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:43.640311 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d3bb5cc9-3f2f-4841-b23e-c610a8dd59d5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:43.664181 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b17ac5dd-2d0d-4bf2-a3c1-d0ccd1de4256 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1271 microversion: 2.1 time: 0.138400 Dec 23 12:01:43.675675 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 183/405] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:43 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:43.827392 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5f8d3282-1be4-4fa4-b212-b75fc43e678d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:43.828394 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5f8d3282-1be4-4fa4-b212-b75fc43e678d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:43.835219 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5f8d3282-1be4-4fa4-b212-b75fc43e678d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:43.835871 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5f8d3282-1be4-4fa4-b212-b75fc43e678d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:43.837063 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5f8d3282-1be4-4fa4-b212-b75fc43e678d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:43.837654 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5f8d3282-1be4-4fa4-b212-b75fc43e678d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:43.862211 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-d3bb5cc9-3f2f-4841-b23e-c610a8dd59d5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:43.876460 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d3bb5cc9-3f2f-4841-b23e-c610a8dd59d5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.254943 Dec 23 12:01:43.877042 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 223/406] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:43 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:44.096577 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-5f8d3282-1be4-4fa4-b212-b75fc43e678d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:44.105578 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-5f8d3282-1be4-4fa4-b212-b75fc43e678d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:44.107076 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-5f8d3282-1be4-4fa4-b212-b75fc43e678d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:44.108382 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5f8d3282-1be4-4fa4-b212-b75fc43e678d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1741 microversion: 2.20 time: 0.284847 Dec 23 12:01:44.119718 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 184/407] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:43 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1741 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:01:44.681853 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a5ca848d-1b78-490f-b004-7c20e09dd98a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:44.682757 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a5ca848d-1b78-490f-b004-7c20e09dd98a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:44.694869 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a5ca848d-1b78-490f-b004-7c20e09dd98a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:44.695723 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a5ca848d-1b78-490f-b004-7c20e09dd98a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:44.697173 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a5ca848d-1b78-490f-b004-7c20e09dd98a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:44.697821 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a5ca848d-1b78-490f-b004-7c20e09dd98a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:44.893867 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4a77bdd7-2e04-4068-89b7-3b76d5e67bd4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:44.910950 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4a77bdd7-2e04-4068-89b7-3b76d5e67bd4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:44.927309 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4a77bdd7-2e04-4068-89b7-3b76d5e67bd4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:44.929053 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4a77bdd7-2e04-4068-89b7-3b76d5e67bd4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:44.931438 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4a77bdd7-2e04-4068-89b7-3b76d5e67bd4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:44.932237 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4a77bdd7-2e04-4068-89b7-3b76d5e67bd4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:45.037254 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-a5ca848d-1b78-490f-b004-7c20e09dd98a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:45.045770 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a5ca848d-1b78-490f-b004-7c20e09dd98a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1319 microversion: 2.1 time: 0.367845 Dec 23 12:01:45.046564 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 224/408] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:44 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:45.127448 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3d1afb25-72ce-47b9-98b4-9ef2faf4f606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:45.128430 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3d1afb25-72ce-47b9-98b4-9ef2faf4f606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:45.136414 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3d1afb25-72ce-47b9-98b4-9ef2faf4f606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:45.137186 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3d1afb25-72ce-47b9-98b4-9ef2faf4f606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:45.138189 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3d1afb25-72ce-47b9-98b4-9ef2faf4f606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:45.138869 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3d1afb25-72ce-47b9-98b4-9ef2faf4f606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:45.202808 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4a77bdd7-2e04-4068-89b7-3b76d5e67bd4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:45.211157 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4a77bdd7-2e04-4068-89b7-3b76d5e67bd4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.320889 Dec 23 12:01:45.223887 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 185/409] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:44 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:45.426796 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3d1afb25-72ce-47b9-98b4-9ef2faf4f606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:45.435834 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3d1afb25-72ce-47b9-98b4-9ef2faf4f606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:45.437901 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3d1afb25-72ce-47b9-98b4-9ef2faf4f606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:45.439416 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3d1afb25-72ce-47b9-98b4-9ef2faf4f606 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1741 microversion: 2.20 time: 0.315817 Dec 23 12:01:45.440190 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 225/410] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:45 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1741 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:01:45.628218 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-3cc9a5da-620b-47dd-b5b9-f54c1e883501 req-d7bf19e5-680a-40df-bcae-e46862d0a624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68e5b661-c9f6-4d62-8a57-8aec6a201f21", "tag": "11258d40-4dbb-42a5-ad95-431f3b8b1f82"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:01:45.630203 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:01:45.630203 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:01:45.637779 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-3cc9a5da-620b-47dd-b5b9-f54c1e883501 req-d7bf19e5-680a-40df-bcae-e46862d0a624 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:45.638551 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-3cc9a5da-620b-47dd-b5b9-f54c1e883501 req-d7bf19e5-680a-40df-bcae-e46862d0a624 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:45.653697 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-3cc9a5da-620b-47dd-b5b9-f54c1e883501 req-d7bf19e5-680a-40df-bcae-e46862d0a624 service nova] Creating event network-changed:11258d40-4dbb-42a5-ad95-431f3b8b1f82 for instance 68e5b661-c9f6-4d62-8a57-8aec6a201f21 on hv-cinder-82282 Dec 23 12:01:45.660205 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-3cc9a5da-620b-47dd-b5b9-f54c1e883501 req-d7bf19e5-680a-40df-bcae-e46862d0a624 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035725 Dec 23 12:01:45.663214 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 186/411] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:01:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:01:46.063494 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5855d1b3-ff17-4c6d-94d2-0fda8f3d1bbc tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:46.064114 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5855d1b3-ff17-4c6d-94d2-0fda8f3d1bbc tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:46.071578 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5855d1b3-ff17-4c6d-94d2-0fda8f3d1bbc tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:46.073611 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5855d1b3-ff17-4c6d-94d2-0fda8f3d1bbc tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:46.074727 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5855d1b3-ff17-4c6d-94d2-0fda8f3d1bbc tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:46.075471 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5855d1b3-ff17-4c6d-94d2-0fda8f3d1bbc tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:46.231317 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-66b279fa-31ff-42ff-8438-9ca7a8d8c97f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:46.232037 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-66b279fa-31ff-42ff-8438-9ca7a8d8c97f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:46.260065 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-66b279fa-31ff-42ff-8438-9ca7a8d8c97f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:46.261848 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-66b279fa-31ff-42ff-8438-9ca7a8d8c97f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:46.266629 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-66b279fa-31ff-42ff-8438-9ca7a8d8c97f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:46.267161 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-66b279fa-31ff-42ff-8438-9ca7a8d8c97f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:46.292671 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-5855d1b3-ff17-4c6d-94d2-0fda8f3d1bbc tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:46.304049 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5855d1b3-ff17-4c6d-94d2-0fda8f3d1bbc tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1319 microversion: 2.1 time: 0.241317 Dec 23 12:01:46.305826 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 226/412] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:46 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:46.402736 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-208016660", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1304321284", "security_groups": [{"name": "tempest-secgroup-smoke-2115882063"}], "networks": [{"uuid": "b74e4f96-0c79-4be3-88be-9335e56fc15a"}], "block_device_mapping_v2": [{"uuid": "454a72ff-ed3e-4c6c-badc-7b0933da141b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:01:46.636391 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.network.neutron [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] validate_networks() for [('b74e4f96-0c79-4be3-88be-9335e56fc15a', None, None, None, None, None)] {{(pid=116354) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 12:01:46.644276 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-66b279fa-31ff-42ff-8438-9ca7a8d8c97f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:46.653833 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-66b279fa-31ff-42ff-8438-9ca7a8d8c97f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.426958 Dec 23 12:01:46.660209 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 187/413] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:46 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:46.672833 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8eca775b-0254-4e9b-9829-8678e575e0c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:46.673447 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-8eca775b-0254-4e9b-9829-8678e575e0c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:46.679631 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8eca775b-0254-4e9b-9829-8678e575e0c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:46.680081 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8eca775b-0254-4e9b-9829-8678e575e0c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:46.680913 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8eca775b-0254-4e9b-9829-8678e575e0c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:46.681525 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8eca775b-0254-4e9b-9829-8678e575e0c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:46.909224 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-8eca775b-0254-4e9b-9829-8678e575e0c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:46.919417 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-8eca775b-0254-4e9b-9829-8678e575e0c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:46.921414 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-8eca775b-0254-4e9b-9829-8678e575e0c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:46.923107 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-8eca775b-0254-4e9b-9829-8678e575e0c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1741 microversion: 2.20 time: 0.259193 Dec 23 12:01:46.934880 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 188/414] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:46 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1741 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:47.143764 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Flavor limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 12:01:47.144261 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Image limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 12:01:47.144645 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Flavor pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 12:01:47.145051 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Image pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 12:01:47.145462 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 12:01:47.159663 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:47.160026 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:47.160843 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:47.161279 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:47.180487 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Getting quotas for project f78243e9c4ec4d51a07e39bec8a14073. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:01:47.184774 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Getting quotas for user 3d641a1c7e09494d86fe4a3bb88a6309 and project f78243e9c4ec4d51a07e39bec8a14073. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:01:47.246801 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Going to run 1 instances... {{(pid=116354) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 12:01:47.250656 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='454a72ff-ed3e-4c6c-badc-7b0933da141b',volume_size=None,volume_type=None)] {{(pid=116354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 12:01:47.321165 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5738a34c-a238-484d-ba0c-67e6fa74caf9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:47.322386 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5738a34c-a238-484d-ba0c-67e6fa74caf9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:47.329320 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5738a34c-a238-484d-ba0c-67e6fa74caf9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:47.330041 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5738a34c-a238-484d-ba0c-67e6fa74caf9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:47.331044 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5738a34c-a238-484d-ba0c-67e6fa74caf9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:47.331672 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5738a34c-a238-484d-ba0c-67e6fa74caf9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:47.422626 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [984b914c-5c51-4d97-8778-ba11b05978ae] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 23 12:01:47.683956 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-5738a34c-a238-484d-ba0c-67e6fa74caf9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:47.691983 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5738a34c-a238-484d-ba0c-67e6fa74caf9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1319 microversion: 2.1 time: 0.374381 Dec 23 12:01:47.692645 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 189/415] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:47 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:47.701904 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f54ed569-0780-435a-9949-43f3d7bc3d98 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:47.701904 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f54ed569-0780-435a-9949-43f3d7bc3d98 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:47.704544 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f54ed569-0780-435a-9949-43f3d7bc3d98 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:47.704997 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f54ed569-0780-435a-9949-43f3d7bc3d98 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:47.705797 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f54ed569-0780-435a-9949-43f3d7bc3d98 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:47.706233 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f54ed569-0780-435a-9949-43f3d7bc3d98 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:47.855694 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-f54ed569-0780-435a-9949-43f3d7bc3d98 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:47.871416 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f54ed569-0780-435a-9949-43f3d7bc3d98 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.177717 Dec 23 12:01:47.871978 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 190/416] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:47 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:47.945370 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ffda5984-663d-46cc-ba46-4de9a7cf8277 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:47.946242 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ffda5984-663d-46cc-ba46-4de9a7cf8277 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:47.953142 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ffda5984-663d-46cc-ba46-4de9a7cf8277 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:47.953819 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ffda5984-663d-46cc-ba46-4de9a7cf8277 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:47.954622 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ffda5984-663d-46cc-ba46-4de9a7cf8277 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:47.955171 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ffda5984-663d-46cc-ba46-4de9a7cf8277 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:48.104386 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ffda5984-663d-46cc-ba46-4de9a7cf8277 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:48.113322 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ffda5984-663d-46cc-ba46-4de9a7cf8277 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:48.114845 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ffda5984-663d-46cc-ba46-4de9a7cf8277 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:48.116008 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ffda5984-663d-46cc-ba46-4de9a7cf8277 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1741 microversion: 2.20 time: 0.177321 Dec 23 12:01:48.116567 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 191/417] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:47 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:48.434628 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO oslo.messaging._drivers.impl_rabbit [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [984b914c-5c51-4d97-8778-ba11b05978ae] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 58856. Dec 23 12:01:48.439279 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a48c936c-0008-4fab-afa4-a549f6bc3380 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.040937 Dec 23 12:01:48.439939 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 227/418] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 12:01:46 2021] POST /compute/v2.1/servers => generated 406 bytes in 2042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 12:01:48.449866 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-00d10a42-d7d6-4eac-854b-fcfeed8a7e5e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:48.450549 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-00d10a42-d7d6-4eac-854b-fcfeed8a7e5e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:48.504002 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-00d10a42-d7d6-4eac-854b-fcfeed8a7e5e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:48.510460 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-00d10a42-d7d6-4eac-854b-fcfeed8a7e5e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1088 microversion: 2.1 time: 0.064325 Dec 23 12:01:48.511080 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 192/419] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:48 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:48.708639 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-18520033-5e9f-46c1-9fa9-bbe987f28d07 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:48.709460 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-18520033-5e9f-46c1-9fa9-bbe987f28d07 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:48.716457 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-18520033-5e9f-46c1-9fa9-bbe987f28d07 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:48.716962 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-18520033-5e9f-46c1-9fa9-bbe987f28d07 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:48.717751 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-18520033-5e9f-46c1-9fa9-bbe987f28d07 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:48.718387 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-18520033-5e9f-46c1-9fa9-bbe987f28d07 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:48.849342 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-18520033-5e9f-46c1-9fa9-bbe987f28d07 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:48.856915 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-18520033-5e9f-46c1-9fa9-bbe987f28d07 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1319 microversion: 2.1 time: 0.151993 Dec 23 12:01:48.857414 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 228/420] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:48 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:48.888411 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4dcb4f04-af3c-49be-94a0-997f376fe252 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:48.889049 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4dcb4f04-af3c-49be-94a0-997f376fe252 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:48.895473 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4dcb4f04-af3c-49be-94a0-997f376fe252 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:48.895932 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4dcb4f04-af3c-49be-94a0-997f376fe252 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:48.896716 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4dcb4f04-af3c-49be-94a0-997f376fe252 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:48.897155 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4dcb4f04-af3c-49be-94a0-997f376fe252 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:49.052118 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4dcb4f04-af3c-49be-94a0-997f376fe252 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:49.061610 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4dcb4f04-af3c-49be-94a0-997f376fe252 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.176878 Dec 23 12:01:49.062186 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 193/421] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:48 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:49.135965 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4252d2ae-cdd1-4a4c-aa6d-fec3b717ab14 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:49.136469 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4252d2ae-cdd1-4a4c-aa6d-fec3b717ab14 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:49.143358 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4252d2ae-cdd1-4a4c-aa6d-fec3b717ab14 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:49.143816 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4252d2ae-cdd1-4a4c-aa6d-fec3b717ab14 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:49.144602 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4252d2ae-cdd1-4a4c-aa6d-fec3b717ab14 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:49.145048 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4252d2ae-cdd1-4a4c-aa6d-fec3b717ab14 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:49.278554 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4252d2ae-cdd1-4a4c-aa6d-fec3b717ab14 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:49.286928 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4252d2ae-cdd1-4a4c-aa6d-fec3b717ab14 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:49.288418 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4252d2ae-cdd1-4a4c-aa6d-fec3b717ab14 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:49.289818 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4252d2ae-cdd1-4a4c-aa6d-fec3b717ab14 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1741 microversion: 2.20 time: 0.158192 Dec 23 12:01:49.290422 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 229/422] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:49 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:49.532216 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ea74a11c-3cb9-4666-8fd7-52b4b6bb3fdc tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:49.534058 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ea74a11c-3cb9-4666-8fd7-52b4b6bb3fdc tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:49.543302 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ea74a11c-3cb9-4666-8fd7-52b4b6bb3fdc tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:49.543669 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ea74a11c-3cb9-4666-8fd7-52b4b6bb3fdc tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:49.544443 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ea74a11c-3cb9-4666-8fd7-52b4b6bb3fdc tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:49.545060 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ea74a11c-3cb9-4666-8fd7-52b4b6bb3fdc tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:49.634341 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ea74a11c-3cb9-4666-8fd7-52b4b6bb3fdc tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:49.642492 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ea74a11c-3cb9-4666-8fd7-52b4b6bb3fdc tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1138 microversion: 2.1 time: 0.117697 Dec 23 12:01:49.643207 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 194/423] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:49 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1138 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:49.873551 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-64601dc1-53f6-4994-b6ee-51d59851698a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:49.874177 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-64601dc1-53f6-4994-b6ee-51d59851698a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:49.880411 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-64601dc1-53f6-4994-b6ee-51d59851698a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:49.880776 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-64601dc1-53f6-4994-b6ee-51d59851698a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:49.881568 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-64601dc1-53f6-4994-b6ee-51d59851698a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:49.881993 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-64601dc1-53f6-4994-b6ee-51d59851698a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:50.019854 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-64601dc1-53f6-4994-b6ee-51d59851698a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:50.027465 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-64601dc1-53f6-4994-b6ee-51d59851698a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1319 microversion: 2.1 time: 0.157590 Dec 23 12:01:50.028038 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 230/424] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:49 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:50.078771 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f319983d-2f7c-415a-bc2b-860f1a90817f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:50.079302 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f319983d-2f7c-415a-bc2b-860f1a90817f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:50.085918 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f319983d-2f7c-415a-bc2b-860f1a90817f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:50.086367 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f319983d-2f7c-415a-bc2b-860f1a90817f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:50.087400 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f319983d-2f7c-415a-bc2b-860f1a90817f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:50.087884 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f319983d-2f7c-415a-bc2b-860f1a90817f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:50.245387 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-f319983d-2f7c-415a-bc2b-860f1a90817f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:50.253656 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f319983d-2f7c-415a-bc2b-860f1a90817f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.178743 Dec 23 12:01:50.254204 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 195/425] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:50 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:50.313049 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-60a6e413-0fec-4df0-a8c7-e4a72cabdde1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:50.313945 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-60a6e413-0fec-4df0-a8c7-e4a72cabdde1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:50.320631 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-60a6e413-0fec-4df0-a8c7-e4a72cabdde1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:50.321174 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-60a6e413-0fec-4df0-a8c7-e4a72cabdde1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:50.321959 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-60a6e413-0fec-4df0-a8c7-e4a72cabdde1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:50.322394 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-60a6e413-0fec-4df0-a8c7-e4a72cabdde1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:50.466026 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-60a6e413-0fec-4df0-a8c7-e4a72cabdde1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:50.473971 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-60a6e413-0fec-4df0-a8c7-e4a72cabdde1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:50.475520 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-60a6e413-0fec-4df0-a8c7-e4a72cabdde1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:50.476693 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-60a6e413-0fec-4df0-a8c7-e4a72cabdde1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1723 microversion: 2.20 time: 0.167501 Dec 23 12:01:50.477324 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 231/426] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:50 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:50.659897 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-af7b0ea0-0630-4565-aed0-008acf870bae tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:50.660521 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-af7b0ea0-0630-4565-aed0-008acf870bae tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:50.667784 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-af7b0ea0-0630-4565-aed0-008acf870bae tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:50.668221 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-af7b0ea0-0630-4565-aed0-008acf870bae tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:50.669015 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-af7b0ea0-0630-4565-aed0-008acf870bae tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:50.669454 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-af7b0ea0-0630-4565-aed0-008acf870bae tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:50.765012 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-af7b0ea0-0630-4565-aed0-008acf870bae tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:50.773379 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-af7b0ea0-0630-4565-aed0-008acf870bae tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1186 microversion: 2.1 time: 0.117272 Dec 23 12:01:50.782667 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 196/427] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:50 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1186 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:51.044870 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f0b335cc-0413-41da-9bb0-ee9b8784fb59 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:51.045264 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f0b335cc-0413-41da-9bb0-ee9b8784fb59 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:51.054557 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f0b335cc-0413-41da-9bb0-ee9b8784fb59 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:51.055248 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f0b335cc-0413-41da-9bb0-ee9b8784fb59 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:51.056377 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f0b335cc-0413-41da-9bb0-ee9b8784fb59 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:51.056984 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f0b335cc-0413-41da-9bb0-ee9b8784fb59 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:51.270725 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e6e76588-6e9e-4837-8c5a-bbf8862843a2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:51.271326 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e6e76588-6e9e-4837-8c5a-bbf8862843a2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:51.277930 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6e76588-6e9e-4837-8c5a-bbf8862843a2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:51.279257 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6e76588-6e9e-4837-8c5a-bbf8862843a2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:51.280047 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6e76588-6e9e-4837-8c5a-bbf8862843a2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:51.280478 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6e76588-6e9e-4837-8c5a-bbf8862843a2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:51.419205 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f0b335cc-0413-41da-9bb0-ee9b8784fb59 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:51.427553 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f0b335cc-0413-41da-9bb0-ee9b8784fb59 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1319 microversion: 2.1 time: 0.386734 Dec 23 12:01:51.428431 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 232/428] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:51 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:51.496286 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9188303b-7466-42ac-bc5a-dec45317f29b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:51.497036 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9188303b-7466-42ac-bc5a-dec45317f29b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:51.503422 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9188303b-7466-42ac-bc5a-dec45317f29b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:51.503870 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9188303b-7466-42ac-bc5a-dec45317f29b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:51.504672 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9188303b-7466-42ac-bc5a-dec45317f29b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:51.505102 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9188303b-7466-42ac-bc5a-dec45317f29b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:51.563102 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e6e76588-6e9e-4837-8c5a-bbf8862843a2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:51.571455 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e6e76588-6e9e-4837-8c5a-bbf8862843a2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.304520 Dec 23 12:01:51.572000 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 197/429] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:51 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:51.732674 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9188303b-7466-42ac-bc5a-dec45317f29b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:51.741559 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9188303b-7466-42ac-bc5a-dec45317f29b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:51.743388 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9188303b-7466-42ac-bc5a-dec45317f29b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:51.744786 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9188303b-7466-42ac-bc5a-dec45317f29b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1723 microversion: 2.20 time: 0.253041 Dec 23 12:01:51.745481 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 233/430] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:51 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:51.790245 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5cea00a6-1079-42fc-ab8e-f9ce60755cf5 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:51.791616 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5cea00a6-1079-42fc-ab8e-f9ce60755cf5 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:51.798564 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5cea00a6-1079-42fc-ab8e-f9ce60755cf5 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:51.799006 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5cea00a6-1079-42fc-ab8e-f9ce60755cf5 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:51.799793 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5cea00a6-1079-42fc-ab8e-f9ce60755cf5 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:51.800231 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5cea00a6-1079-42fc-ab8e-f9ce60755cf5 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:51.885595 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-5cea00a6-1079-42fc-ab8e-f9ce60755cf5 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:51.893101 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5cea00a6-1079-42fc-ab8e-f9ce60755cf5 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1204 microversion: 2.1 time: 0.106614 Dec 23 12:01:51.893694 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 198/431] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:51 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1204 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:52.444767 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-25ccd6d4-6d16-4133-95f6-0bc418899031 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:52.445306 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-25ccd6d4-6d16-4133-95f6-0bc418899031 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:52.451837 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-25ccd6d4-6d16-4133-95f6-0bc418899031 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:52.452287 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-25ccd6d4-6d16-4133-95f6-0bc418899031 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:52.453061 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-25ccd6d4-6d16-4133-95f6-0bc418899031 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:52.453488 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-25ccd6d4-6d16-4133-95f6-0bc418899031 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:52.589006 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-bff0d79a-736b-4dbc-9cc9-d6c7f069a533 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:52.589586 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-bff0d79a-736b-4dbc-9cc9-d6c7f069a533 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:52.596362 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bff0d79a-736b-4dbc-9cc9-d6c7f069a533 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:52.596801 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bff0d79a-736b-4dbc-9cc9-d6c7f069a533 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:52.597914 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bff0d79a-736b-4dbc-9cc9-d6c7f069a533 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:52.598480 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bff0d79a-736b-4dbc-9cc9-d6c7f069a533 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:52.686500 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-25ccd6d4-6d16-4133-95f6-0bc418899031 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:52.696365 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-25ccd6d4-6d16-4133-95f6-0bc418899031 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1319 microversion: 2.1 time: 0.254817 Dec 23 12:01:52.698387 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 234/432] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:52 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:52.703538 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-f4d876e5-3458-4780-a6bc-1901acb1d3d1 req-cdadfdf7-ec0f-40b6-a719-07738ca49cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc998144-5288-467f-82de-9c1983559e40", "name": "network-vif-unplugged", "status": "completed", "tag": "bbf34ca1-ab1a-4521-9402-ff6d335fe55a"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:01:52.705419 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:01:52.705419 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:01:52.713005 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-f4d876e5-3458-4780-a6bc-1901acb1d3d1 req-cdadfdf7-ec0f-40b6-a719-07738ca49cd9 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:52.713729 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-f4d876e5-3458-4780-a6bc-1901acb1d3d1 req-cdadfdf7-ec0f-40b6-a719-07738ca49cd9 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:52.729581 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-f4d876e5-3458-4780-a6bc-1901acb1d3d1 req-cdadfdf7-ec0f-40b6-a719-07738ca49cd9 service nova] Creating event network-vif-unplugged:bbf34ca1-ab1a-4521-9402-ff6d335fe55a for instance fc998144-5288-467f-82de-9c1983559e40 on hv-cinder-82282 Dec 23 12:01:52.737525 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-f4d876e5-3458-4780-a6bc-1901acb1d3d1 req-cdadfdf7-ec0f-40b6-a719-07738ca49cd9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037382 Dec 23 12:01:52.740911 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 235/433] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:01:52 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:01:52.770364 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-57191a5d-0d3e-4624-b319-18b58d627e90 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:52.777029 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-57191a5d-0d3e-4624-b319-18b58d627e90 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:52.788930 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-57191a5d-0d3e-4624-b319-18b58d627e90 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:52.790377 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-57191a5d-0d3e-4624-b319-18b58d627e90 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:52.794293 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-57191a5d-0d3e-4624-b319-18b58d627e90 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:52.794932 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-57191a5d-0d3e-4624-b319-18b58d627e90 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:52.907413 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-bff0d79a-736b-4dbc-9cc9-d6c7f069a533 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:52.916908 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-bff0d79a-736b-4dbc-9cc9-d6c7f069a533 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.331999 Dec 23 12:01:52.917639 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 199/434] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:52 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:52.922407 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-cd503a47-1d05-4661-b448-50143b23ca35 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:52.923312 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-cd503a47-1d05-4661-b448-50143b23ca35 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:52.930624 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cd503a47-1d05-4661-b448-50143b23ca35 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:52.931408 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cd503a47-1d05-4661-b448-50143b23ca35 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:52.932400 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cd503a47-1d05-4661-b448-50143b23ca35 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:52.932898 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cd503a47-1d05-4661-b448-50143b23ca35 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:53.114846 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-57191a5d-0d3e-4624-b319-18b58d627e90 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:53.123980 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-57191a5d-0d3e-4624-b319-18b58d627e90 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:53.125784 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-57191a5d-0d3e-4624-b319-18b58d627e90 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:53.127009 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-57191a5d-0d3e-4624-b319-18b58d627e90 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1723 microversion: 2.20 time: 0.366704 Dec 23 12:01:53.127545 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 236/435] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:52 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1723 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:53.225906 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-c797a0d3-86be-47c2-b1d2-790100de3702 req-e55eb1e9-2939-483b-8692-51032c66d9cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d087055b-27de-4c01-962a-5744a4c4cd7d", "tag": "ec4101a7-3a3b-4137-ac8f-4d9146a15ac1"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:01:53.228858 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:01:53.228858 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:01:53.239950 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-c797a0d3-86be-47c2-b1d2-790100de3702 req-e55eb1e9-2939-483b-8692-51032c66d9cf service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:53.240715 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-c797a0d3-86be-47c2-b1d2-790100de3702 req-e55eb1e9-2939-483b-8692-51032c66d9cf service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:53.243053 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-cd503a47-1d05-4661-b448-50143b23ca35 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:53.253050 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-cd503a47-1d05-4661-b448-50143b23ca35 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.333915 Dec 23 12:01:53.253639 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 200/436] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:52 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:53.265412 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-c797a0d3-86be-47c2-b1d2-790100de3702 req-e55eb1e9-2939-483b-8692-51032c66d9cf service nova] Creating event network-changed:ec4101a7-3a3b-4137-ac8f-4d9146a15ac1 for instance d087055b-27de-4c01-962a-5744a4c4cd7d on hv-cinder-82282 Dec 23 12:01:53.271256 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-c797a0d3-86be-47c2-b1d2-790100de3702 req-e55eb1e9-2939-483b-8692-51032c66d9cf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050278 Dec 23 12:01:53.279100 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 237/437] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:01:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:01:53.713412 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-123370dc-0a0e-478d-a8df-8e0e62cfdb48 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:53.714025 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-123370dc-0a0e-478d-a8df-8e0e62cfdb48 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:53.720781 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-123370dc-0a0e-478d-a8df-8e0e62cfdb48 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:53.721309 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-123370dc-0a0e-478d-a8df-8e0e62cfdb48 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:53.722093 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-123370dc-0a0e-478d-a8df-8e0e62cfdb48 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:53.722544 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-123370dc-0a0e-478d-a8df-8e0e62cfdb48 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:53.896919 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-123370dc-0a0e-478d-a8df-8e0e62cfdb48 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:53.904718 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-123370dc-0a0e-478d-a8df-8e0e62cfdb48 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1319 microversion: 2.1 time: 0.195133 Dec 23 12:01:53.905249 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 201/438] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:53 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:53.938210 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-be5a7c70-d656-4759-82e3-d38a0edcb89d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:53.938976 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-be5a7c70-d656-4759-82e3-d38a0edcb89d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:53.948229 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-be5a7c70-d656-4759-82e3-d38a0edcb89d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:53.948680 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-be5a7c70-d656-4759-82e3-d38a0edcb89d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:53.949561 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-be5a7c70-d656-4759-82e3-d38a0edcb89d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:53.950086 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-be5a7c70-d656-4759-82e3-d38a0edcb89d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:54.146870 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-15be824f-8e40-4168-acd2-c6df4bbb1180 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:54.147480 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-15be824f-8e40-4168-acd2-c6df4bbb1180 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:54.153912 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-15be824f-8e40-4168-acd2-c6df4bbb1180 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:54.154360 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-15be824f-8e40-4168-acd2-c6df4bbb1180 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:54.155159 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-15be824f-8e40-4168-acd2-c6df4bbb1180 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:54.155589 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-15be824f-8e40-4168-acd2-c6df4bbb1180 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:54.173380 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-be5a7c70-d656-4759-82e3-d38a0edcb89d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:54.183355 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-be5a7c70-d656-4759-82e3-d38a0edcb89d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.251559 Dec 23 12:01:54.192976 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 238/439] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:53 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:54.270938 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-21c4d972-75d0-4625-91c3-1a380003a5f4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:54.271554 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-21c4d972-75d0-4625-91c3-1a380003a5f4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:54.278359 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-21c4d972-75d0-4625-91c3-1a380003a5f4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:54.278858 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-21c4d972-75d0-4625-91c3-1a380003a5f4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:54.279651 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-21c4d972-75d0-4625-91c3-1a380003a5f4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:54.280080 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-21c4d972-75d0-4625-91c3-1a380003a5f4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:54.649943 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-15be824f-8e40-4168-acd2-c6df4bbb1180 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:54.658486 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-15be824f-8e40-4168-acd2-c6df4bbb1180 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:54.660267 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-15be824f-8e40-4168-acd2-c6df4bbb1180 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:54.661430 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-15be824f-8e40-4168-acd2-c6df4bbb1180 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1726 microversion: 2.20 time: 0.518363 Dec 23 12:01:54.661979 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 202/440] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:54 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1726 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:54.679846 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5e614d4b-b9d8-4a9f-82b3-cf0b2badded0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57b62b99-6cdd-4410-8e8e-07aa2402c709"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:01:54.681208 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5e614d4b-b9d8-4a9f-82b3-cf0b2badded0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:54.687391 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5e614d4b-b9d8-4a9f-82b3-cf0b2badded0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:54.688029 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5e614d4b-b9d8-4a9f-82b3-cf0b2badded0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:54.688830 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5e614d4b-b9d8-4a9f-82b3-cf0b2badded0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:54.689263 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5e614d4b-b9d8-4a9f-82b3-cf0b2badded0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:54.696330 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-21c4d972-75d0-4625-91c3-1a380003a5f4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:54.707199 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-21c4d972-75d0-4625-91c3-1a380003a5f4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.439457 Dec 23 12:01:54.709859 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 239/441] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:54 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:54.758108 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-9f2601f5-8dfe-4b19-8876-c9ad82aeee06 req-0193ef25-2f31-4a65-ad24-af4040417d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e5b661-c9f6-4d62-8a57-8aec6a201f21", "name": "network-vif-plugged", "status": "completed", "tag": "11258d40-4dbb-42a5-ad95-431f3b8b1f82"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:01:54.760666 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:01:54.760666 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:01:54.768211 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-9f2601f5-8dfe-4b19-8876-c9ad82aeee06 req-0193ef25-2f31-4a65-ad24-af4040417d29 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:54.768750 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-9f2601f5-8dfe-4b19-8876-c9ad82aeee06 req-0193ef25-2f31-4a65-ad24-af4040417d29 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:54.782470 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-9f2601f5-8dfe-4b19-8876-c9ad82aeee06 req-0193ef25-2f31-4a65-ad24-af4040417d29 service nova] Creating event network-vif-plugged:11258d40-4dbb-42a5-ad95-431f3b8b1f82 for instance 68e5b661-c9f6-4d62-8a57-8aec6a201f21 on hv-cinder-82282 Dec 23 12:01:54.787940 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-9f2601f5-8dfe-4b19-8876-c9ad82aeee06 req-0193ef25-2f31-4a65-ad24-af4040417d29 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034898 Dec 23 12:01:54.788685 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 240/442] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:01:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 12:01:54.922564 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-be26b550-862a-4195-b379-ca93c1b16c90 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:54.923274 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-be26b550-862a-4195-b379-ca93c1b16c90 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:54.930451 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-be26b550-862a-4195-b379-ca93c1b16c90 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:54.930944 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-be26b550-862a-4195-b379-ca93c1b16c90 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:54.931769 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-be26b550-862a-4195-b379-ca93c1b16c90 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:54.932214 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-be26b550-862a-4195-b379-ca93c1b16c90 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:54.982490 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5e614d4b-b9d8-4a9f-82b3-cf0b2badded0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306458 Dec 23 12:01:54.983647 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 203/443] 10.222.0.65 () {62 vars in 1363 bytes} [Thu Dec 23 12:01:54 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 23 12:01:55.099685 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2170cae2-72c0-46ef-ae18-be770b0316fd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:01:55.100259 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2170cae2-72c0-46ef-ae18-be770b0316fd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:55.107035 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2170cae2-72c0-46ef-ae18-be770b0316fd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:55.107457 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2170cae2-72c0-46ef-ae18-be770b0316fd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:55.109237 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2170cae2-72c0-46ef-ae18-be770b0316fd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:55.109704 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2170cae2-72c0-46ef-ae18-be770b0316fd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:55.120353 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-be26b550-862a-4195-b379-ca93c1b16c90 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:55.128666 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-be26b550-862a-4195-b379-ca93c1b16c90 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1319 microversion: 2.1 time: 0.209632 Dec 23 12:01:55.128666 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 241/444] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:54 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:55.200258 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5dd4ca00-1f1f-4643-8cf5-268e2590cd85 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:55.200960 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5dd4ca00-1f1f-4643-8cf5-268e2590cd85 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:55.207126 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5dd4ca00-1f1f-4643-8cf5-268e2590cd85 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:55.207794 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5dd4ca00-1f1f-4643-8cf5-268e2590cd85 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:55.208872 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5dd4ca00-1f1f-4643-8cf5-268e2590cd85 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:55.209446 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5dd4ca00-1f1f-4643-8cf5-268e2590cd85 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:55.212597 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2170cae2-72c0-46ef-ae18-be770b0316fd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action" status: 202 len: 0 microversion: 2.20 time: 0.116637 Dec 23 12:01:55.214662 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 204/445] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:01:55 2021] POST /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 23 12:01:55.223420 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4a6bf2d3-f906-4a21-8e17-f881b57768d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:55.223874 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4a6bf2d3-f906-4a21-8e17-f881b57768d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:55.230015 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4a6bf2d3-f906-4a21-8e17-f881b57768d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:55.230472 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4a6bf2d3-f906-4a21-8e17-f881b57768d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:55.231321 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4a6bf2d3-f906-4a21-8e17-f881b57768d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:55.231762 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4a6bf2d3-f906-4a21-8e17-f881b57768d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:55.430951 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-5dd4ca00-1f1f-4643-8cf5-268e2590cd85 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:55.439904 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5dd4ca00-1f1f-4643-8cf5-268e2590cd85 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.243341 Dec 23 12:01:55.441013 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 242/446] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:55 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:01:55.451097 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4a6bf2d3-f906-4a21-8e17-f881b57768d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:55.459856 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4a6bf2d3-f906-4a21-8e17-f881b57768d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:55.461569 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4a6bf2d3-f906-4a21-8e17-f881b57768d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:55.462820 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4a6bf2d3-f906-4a21-8e17-f881b57768d6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1752 microversion: 2.20 time: 0.243257 Dec 23 12:01:55.463368 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 205/447] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:55 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1752 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:55.725167 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-6f4409e4-7544-46c9-a5ca-2ed8cd2d48c4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:55.725898 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-6f4409e4-7544-46c9-a5ca-2ed8cd2d48c4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:55.733254 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6f4409e4-7544-46c9-a5ca-2ed8cd2d48c4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:55.733792 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6f4409e4-7544-46c9-a5ca-2ed8cd2d48c4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:55.734719 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6f4409e4-7544-46c9-a5ca-2ed8cd2d48c4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:55.735573 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6f4409e4-7544-46c9-a5ca-2ed8cd2d48c4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:55.903745 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-6f4409e4-7544-46c9-a5ca-2ed8cd2d48c4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:55.912852 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-6f4409e4-7544-46c9-a5ca-2ed8cd2d48c4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.191574 Dec 23 12:01:55.913458 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 243/448] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:55 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:56.144991 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e6e49947-2416-4ee7-8eee-fba55ba14b0a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:56.145655 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e6e49947-2416-4ee7-8eee-fba55ba14b0a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:56.152945 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6e49947-2416-4ee7-8eee-fba55ba14b0a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:56.153611 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6e49947-2416-4ee7-8eee-fba55ba14b0a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:56.154585 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6e49947-2416-4ee7-8eee-fba55ba14b0a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:56.155173 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6e49947-2416-4ee7-8eee-fba55ba14b0a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:56.294589 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e6e49947-2416-4ee7-8eee-fba55ba14b0a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:56.302467 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e6e49947-2416-4ee7-8eee-fba55ba14b0a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1319 microversion: 2.1 time: 0.161118 Dec 23 12:01:56.303056 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 206/449] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:56 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:56.457008 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7b7d80a3-fa77-41b2-b6f7-29ad457542ed tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:56.457623 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-7b7d80a3-fa77-41b2-b6f7-29ad457542ed tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:56.464135 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7b7d80a3-fa77-41b2-b6f7-29ad457542ed tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:56.464592 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7b7d80a3-fa77-41b2-b6f7-29ad457542ed tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:56.465373 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7b7d80a3-fa77-41b2-b6f7-29ad457542ed tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:56.465814 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7b7d80a3-fa77-41b2-b6f7-29ad457542ed tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:56.481112 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-23cc3b42-ce6f-4f05-9b64-ba0058addba8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:56.482044 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-23cc3b42-ce6f-4f05-9b64-ba0058addba8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:56.488477 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-23cc3b42-ce6f-4f05-9b64-ba0058addba8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:56.488948 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-23cc3b42-ce6f-4f05-9b64-ba0058addba8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:56.489813 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-23cc3b42-ce6f-4f05-9b64-ba0058addba8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:56.490325 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-23cc3b42-ce6f-4f05-9b64-ba0058addba8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:56.694391 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-23cc3b42-ce6f-4f05-9b64-ba0058addba8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:56.705347 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-23cc3b42-ce6f-4f05-9b64-ba0058addba8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:56.707499 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-23cc3b42-ce6f-4f05-9b64-ba0058addba8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:56.708807 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-23cc3b42-ce6f-4f05-9b64-ba0058addba8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1754 microversion: 2.20 time: 0.231350 Dec 23 12:01:56.709412 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 207/450] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:56 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1754 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:01:56.721245 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-7b7d80a3-fa77-41b2-b6f7-29ad457542ed tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:56.729078 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-7b7d80a3-fa77-41b2-b6f7-29ad457542ed tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.275717 Dec 23 12:01:56.729651 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 244/451] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:56 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:56.929065 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b5f0956b-f92e-4edc-9e82-a067a7eafdc0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:56.929803 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b5f0956b-f92e-4edc-9e82-a067a7eafdc0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:56.936033 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b5f0956b-f92e-4edc-9e82-a067a7eafdc0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:56.936566 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b5f0956b-f92e-4edc-9e82-a067a7eafdc0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:56.937435 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b5f0956b-f92e-4edc-9e82-a067a7eafdc0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:56.937926 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b5f0956b-f92e-4edc-9e82-a067a7eafdc0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:57.074335 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b5f0956b-f92e-4edc-9e82-a067a7eafdc0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:57.082120 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b5f0956b-f92e-4edc-9e82-a067a7eafdc0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.156638 Dec 23 12:01:57.082610 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 208/452] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:56 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:57.321524 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-49cfb844-3d2e-4470-8a65-f484583aaf11 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:57.321524 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-49cfb844-3d2e-4470-8a65-f484583aaf11 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:57.328486 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-49cfb844-3d2e-4470-8a65-f484583aaf11 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:57.329122 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-49cfb844-3d2e-4470-8a65-f484583aaf11 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:57.339540 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-49cfb844-3d2e-4470-8a65-f484583aaf11 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:57.340475 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-49cfb844-3d2e-4470-8a65-f484583aaf11 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:57.494549 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-49cfb844-3d2e-4470-8a65-f484583aaf11 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:57.502230 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-49cfb844-3d2e-4470-8a65-f484583aaf11 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1508 microversion: 2.1 time: 0.186369 Dec 23 12:01:57.504023 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 245/453] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:57 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:57.728181 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-bba824ab-8783-4ef8-bdc2-e1eb758554ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:57.729372 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-bba824ab-8783-4ef8-bdc2-e1eb758554ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:57.736285 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bba824ab-8783-4ef8-bdc2-e1eb758554ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:57.736753 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bba824ab-8783-4ef8-bdc2-e1eb758554ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:57.737669 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bba824ab-8783-4ef8-bdc2-e1eb758554ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:57.738112 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bba824ab-8783-4ef8-bdc2-e1eb758554ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:57.746289 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3decc419-1181-496d-a7df-ec4faf5c3d8b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:57.747112 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3decc419-1181-496d-a7df-ec4faf5c3d8b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:57.753698 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3decc419-1181-496d-a7df-ec4faf5c3d8b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:57.754387 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3decc419-1181-496d-a7df-ec4faf5c3d8b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:57.755221 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3decc419-1181-496d-a7df-ec4faf5c3d8b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:57.755667 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3decc419-1181-496d-a7df-ec4faf5c3d8b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:57.960665 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-bba824ab-8783-4ef8-bdc2-e1eb758554ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:57.972959 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-bba824ab-8783-4ef8-bdc2-e1eb758554ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:57.978146 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-bba824ab-8783-4ef8-bdc2-e1eb758554ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:57.980085 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-bba824ab-8783-4ef8-bdc2-e1eb758554ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.255228 Dec 23 12:01:57.985957 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 209/454] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:57 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:58.002995 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3decc419-1181-496d-a7df-ec4faf5c3d8b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:58.011927 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3decc419-1181-496d-a7df-ec4faf5c3d8b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.269264 Dec 23 12:01:58.012837 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 246/455] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:57 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:58.099155 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d0ce8dc4-6b55-4f32-8989-56905ec604f7 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:58.099679 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d0ce8dc4-6b55-4f32-8989-56905ec604f7 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:58.106339 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d0ce8dc4-6b55-4f32-8989-56905ec604f7 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:58.106875 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d0ce8dc4-6b55-4f32-8989-56905ec604f7 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:58.107661 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d0ce8dc4-6b55-4f32-8989-56905ec604f7 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:58.108103 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d0ce8dc4-6b55-4f32-8989-56905ec604f7 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:58.293791 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d0ce8dc4-6b55-4f32-8989-56905ec604f7 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:58.304957 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d0ce8dc4-6b55-4f32-8989-56905ec604f7 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.209320 Dec 23 12:01:58.305718 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 210/456] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:58 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:59.007560 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8aba4a82-7d04-4d2e-8e5f-d113b95c738f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:59.008965 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8aba4a82-7d04-4d2e-8e5f-d113b95c738f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:59.019829 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8aba4a82-7d04-4d2e-8e5f-d113b95c738f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:59.020578 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8aba4a82-7d04-4d2e-8e5f-d113b95c738f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:59.021904 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8aba4a82-7d04-4d2e-8e5f-d113b95c738f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:59.023756 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8aba4a82-7d04-4d2e-8e5f-d113b95c738f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:59.033799 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-81a9737e-e0cd-4602-aa24-2b28fd94f36c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:59.034422 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-81a9737e-e0cd-4602-aa24-2b28fd94f36c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:59.042189 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-81a9737e-e0cd-4602-aa24-2b28fd94f36c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:59.042685 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-81a9737e-e0cd-4602-aa24-2b28fd94f36c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:59.043487 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-81a9737e-e0cd-4602-aa24-2b28fd94f36c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:59.043921 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-81a9737e-e0cd-4602-aa24-2b28fd94f36c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:59.241278 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8aba4a82-7d04-4d2e-8e5f-d113b95c738f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:59.248596 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-81a9737e-e0cd-4602-aa24-2b28fd94f36c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:59.251386 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8aba4a82-7d04-4d2e-8e5f-d113b95c738f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:59.253157 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8aba4a82-7d04-4d2e-8e5f-d113b95c738f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:59.254967 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8aba4a82-7d04-4d2e-8e5f-d113b95c738f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.253325 Dec 23 12:01:59.255483 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 247/457] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:01:58 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:01:59.268323 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-81a9737e-e0cd-4602-aa24-2b28fd94f36c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.240543 Dec 23 12:01:59.268986 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 211/458] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:59 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:01:59.321051 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-84acbf5a-76b8-434e-abd1-0e0289716dbd tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:01:59.321959 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-84acbf5a-76b8-434e-abd1-0e0289716dbd tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:01:59.328471 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-84acbf5a-76b8-434e-abd1-0e0289716dbd tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:59.329005 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-84acbf5a-76b8-434e-abd1-0e0289716dbd tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:59.329788 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-84acbf5a-76b8-434e-abd1-0e0289716dbd tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:01:59.330253 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-84acbf5a-76b8-434e-abd1-0e0289716dbd tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:01:59.472042 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-84acbf5a-76b8-434e-abd1-0e0289716dbd tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:01:59.481679 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-84acbf5a-76b8-434e-abd1-0e0289716dbd tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.164450 Dec 23 12:01:59.482267 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 248/459] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:01:59 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:00.048148 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 23 12:02:00.048986 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: Thu Dec 23 12:02:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 23 12:02:00.273643 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d83eac6f-94be-4607-8929-11c88f21c55f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:00.275026 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d83eac6f-94be-4607-8929-11c88f21c55f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:00.281929 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d83eac6f-94be-4607-8929-11c88f21c55f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:00.282381 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d83eac6f-94be-4607-8929-11c88f21c55f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:00.283509 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d83eac6f-94be-4607-8929-11c88f21c55f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:00.284721 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d83eac6f-94be-4607-8929-11c88f21c55f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:00.285138 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f52c3428-8027-4c76-ab99-f4b6472e03d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:00.285763 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f52c3428-8027-4c76-ab99-f4b6472e03d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:00.292546 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f52c3428-8027-4c76-ab99-f4b6472e03d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:00.293006 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f52c3428-8027-4c76-ab99-f4b6472e03d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:00.293839 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f52c3428-8027-4c76-ab99-f4b6472e03d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:00.294313 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f52c3428-8027-4c76-ab99-f4b6472e03d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:00.495280 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d83eac6f-94be-4607-8929-11c88f21c55f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:00.501256 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f52c3428-8027-4c76-ab99-f4b6472e03d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:00.504925 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d83eac6f-94be-4607-8929-11c88f21c55f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:00.506670 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d83eac6f-94be-4607-8929-11c88f21c55f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:00.508101 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d83eac6f-94be-4607-8929-11c88f21c55f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.238696 Dec 23 12:02:00.509313 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 212/460] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:00 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:00.513814 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f52c3428-8027-4c76-ab99-f4b6472e03d6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.232152 Dec 23 12:02:00.515224 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 249/461] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:00 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:00.516405 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3c10eb7e-5d6e-47b2-b7ae-2570b28164ae tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:00.517193 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3c10eb7e-5d6e-47b2-b7ae-2570b28164ae tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:00.525872 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3c10eb7e-5d6e-47b2-b7ae-2570b28164ae tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:00.526553 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3c10eb7e-5d6e-47b2-b7ae-2570b28164ae tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:00.527349 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3c10eb7e-5d6e-47b2-b7ae-2570b28164ae tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:00.527788 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3c10eb7e-5d6e-47b2-b7ae-2570b28164ae tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:00.674555 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3c10eb7e-5d6e-47b2-b7ae-2570b28164ae tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:00.682819 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3c10eb7e-5d6e-47b2-b7ae-2570b28164ae tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.171748 Dec 23 12:02:00.683410 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 213/462] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:00 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:01.538217 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0b39d001-1cdd-4dda-81d1-ba778be5026c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:01.539342 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8047cf0e-f0fe-4318-b02a-785d851ddb40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:01.540740 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8047cf0e-f0fe-4318-b02a-785d851ddb40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:01.542014 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0b39d001-1cdd-4dda-81d1-ba778be5026c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:01.550318 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0b39d001-1cdd-4dda-81d1-ba778be5026c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:01.550566 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8047cf0e-f0fe-4318-b02a-785d851ddb40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:01.550966 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8047cf0e-f0fe-4318-b02a-785d851ddb40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:01.551499 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0b39d001-1cdd-4dda-81d1-ba778be5026c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:01.551770 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8047cf0e-f0fe-4318-b02a-785d851ddb40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:01.552212 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8047cf0e-f0fe-4318-b02a-785d851ddb40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:01.552967 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0b39d001-1cdd-4dda-81d1-ba778be5026c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:01.553623 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0b39d001-1cdd-4dda-81d1-ba778be5026c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:01.784472 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8047cf0e-f0fe-4318-b02a-785d851ddb40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:01.789682 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0b39d001-1cdd-4dda-81d1-ba778be5026c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:01.796169 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8047cf0e-f0fe-4318-b02a-785d851ddb40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:01.798379 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8047cf0e-f0fe-4318-b02a-785d851ddb40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:01.799071 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0b39d001-1cdd-4dda-81d1-ba778be5026c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.266024 Dec 23 12:02:01.799869 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8047cf0e-f0fe-4318-b02a-785d851ddb40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.272252 Dec 23 12:02:01.800457 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 250/463] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:01 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:01.810874 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 214/464] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:01 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:01.816233 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-201a6781-28ef-4642-8b2a-1ae5376bbbd0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:01.816907 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-201a6781-28ef-4642-8b2a-1ae5376bbbd0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:01.823379 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-201a6781-28ef-4642-8b2a-1ae5376bbbd0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:01.823821 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-201a6781-28ef-4642-8b2a-1ae5376bbbd0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:01.824592 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-201a6781-28ef-4642-8b2a-1ae5376bbbd0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:01.825023 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-201a6781-28ef-4642-8b2a-1ae5376bbbd0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:01.965085 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-201a6781-28ef-4642-8b2a-1ae5376bbbd0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:01.972596 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-201a6781-28ef-4642-8b2a-1ae5376bbbd0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.160060 Dec 23 12:02:01.973176 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 251/465] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:01 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:02.817573 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4a481af9-ee54-4eed-99ae-8dbbad5791bc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:02.818847 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4a481af9-ee54-4eed-99ae-8dbbad5791bc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:02.820576 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9328f28a-710e-4df5-a499-5bf43d97bb81 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:02.821762 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9328f28a-710e-4df5-a499-5bf43d97bb81 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:02.825477 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4a481af9-ee54-4eed-99ae-8dbbad5791bc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:02.825930 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4a481af9-ee54-4eed-99ae-8dbbad5791bc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:02.826751 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4a481af9-ee54-4eed-99ae-8dbbad5791bc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:02.827193 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4a481af9-ee54-4eed-99ae-8dbbad5791bc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:02.828603 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9328f28a-710e-4df5-a499-5bf43d97bb81 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:02.829222 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9328f28a-710e-4df5-a499-5bf43d97bb81 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:02.830007 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9328f28a-710e-4df5-a499-5bf43d97bb81 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:02.830586 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9328f28a-710e-4df5-a499-5bf43d97bb81 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:03.023368 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9328f28a-710e-4df5-a499-5bf43d97bb81 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:03.027409 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4a481af9-ee54-4eed-99ae-8dbbad5791bc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:03.032628 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9328f28a-710e-4df5-a499-5bf43d97bb81 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:03.034120 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9328f28a-710e-4df5-a499-5bf43d97bb81 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:03.035300 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9328f28a-710e-4df5-a499-5bf43d97bb81 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.219151 Dec 23 12:02:03.035442 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4a481af9-ee54-4eed-99ae-8dbbad5791bc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.221589 Dec 23 12:02:03.043247 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 252/466] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:02 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:03.043426 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 215/467] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:02 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:03.043513 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c30ffb29-235b-4262-b0ef-33daac7ed04e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:03.043513 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c30ffb29-235b-4262-b0ef-33daac7ed04e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:03.048241 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c30ffb29-235b-4262-b0ef-33daac7ed04e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:03.048697 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c30ffb29-235b-4262-b0ef-33daac7ed04e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:03.049572 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c30ffb29-235b-4262-b0ef-33daac7ed04e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:03.050009 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c30ffb29-235b-4262-b0ef-33daac7ed04e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:03.193744 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c30ffb29-235b-4262-b0ef-33daac7ed04e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:03.204446 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c30ffb29-235b-4262-b0ef-33daac7ed04e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.166514 Dec 23 12:02:03.205068 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 253/468] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:03 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:04.053654 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-79ca68d3-befd-44c6-b1e4-9304a9a07ec4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:04.054246 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-79ca68d3-befd-44c6-b1e4-9304a9a07ec4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:04.056028 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9e7c0b06-ff4f-4314-8410-ba33997b0007 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:04.056709 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9e7c0b06-ff4f-4314-8410-ba33997b0007 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:04.060826 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-79ca68d3-befd-44c6-b1e4-9304a9a07ec4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:04.061292 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-79ca68d3-befd-44c6-b1e4-9304a9a07ec4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:04.062093 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-79ca68d3-befd-44c6-b1e4-9304a9a07ec4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:04.062556 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-79ca68d3-befd-44c6-b1e4-9304a9a07ec4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:04.063592 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9e7c0b06-ff4f-4314-8410-ba33997b0007 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:04.064051 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9e7c0b06-ff4f-4314-8410-ba33997b0007 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:04.064985 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9e7c0b06-ff4f-4314-8410-ba33997b0007 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:04.065482 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9e7c0b06-ff4f-4314-8410-ba33997b0007 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:04.266774 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-79ca68d3-befd-44c6-b1e4-9304a9a07ec4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:04.270191 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9e7c0b06-ff4f-4314-8410-ba33997b0007 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:04.274767 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-79ca68d3-befd-44c6-b1e4-9304a9a07ec4 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.224918 Dec 23 12:02:04.275714 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 216/469] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:04 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:04.278998 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9e7c0b06-ff4f-4314-8410-ba33997b0007 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:04.280527 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9e7c0b06-ff4f-4314-8410-ba33997b0007 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:04.280654 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f94a3ce2-35da-4e19-a2ca-b8639ab41f5a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:04.281330 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f94a3ce2-35da-4e19-a2ca-b8639ab41f5a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:04.281814 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9e7c0b06-ff4f-4314-8410-ba33997b0007 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.230458 Dec 23 12:02:04.284429 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 254/470] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:04 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:04.290732 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f94a3ce2-35da-4e19-a2ca-b8639ab41f5a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:04.291195 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f94a3ce2-35da-4e19-a2ca-b8639ab41f5a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:04.292003 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f94a3ce2-35da-4e19-a2ca-b8639ab41f5a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:04.292434 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f94a3ce2-35da-4e19-a2ca-b8639ab41f5a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:04.427114 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-f94a3ce2-35da-4e19-a2ca-b8639ab41f5a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:04.435381 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f94a3ce2-35da-4e19-a2ca-b8639ab41f5a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.158777 Dec 23 12:02:04.435991 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 217/471] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:04 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:05.291964 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ffc32cda-b829-4235-93cc-724ca09b5dd7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:05.292782 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ffc32cda-b829-4235-93cc-724ca09b5dd7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:05.300201 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ffc32cda-b829-4235-93cc-724ca09b5dd7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:05.300624 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-caaaac02-f890-41b8-96ea-8aa15fa2ac0a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:05.301095 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ffc32cda-b829-4235-93cc-724ca09b5dd7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:05.301435 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ffc32cda-b829-4235-93cc-724ca09b5dd7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:05.301870 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ffc32cda-b829-4235-93cc-724ca09b5dd7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:05.302373 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-caaaac02-f890-41b8-96ea-8aa15fa2ac0a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:05.309874 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-caaaac02-f890-41b8-96ea-8aa15fa2ac0a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:05.310833 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-caaaac02-f890-41b8-96ea-8aa15fa2ac0a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:05.312000 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-caaaac02-f890-41b8-96ea-8aa15fa2ac0a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:05.312713 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-caaaac02-f890-41b8-96ea-8aa15fa2ac0a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:05.716051 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ffc32cda-b829-4235-93cc-724ca09b5dd7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:05.727369 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ffc32cda-b829-4235-93cc-724ca09b5dd7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.439157 Dec 23 12:02:05.730922 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 255/472] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:05 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:05.731091 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-caaaac02-f890-41b8-96ea-8aa15fa2ac0a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:05.732668 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8d1e34a3-64a7-4cc2-be2d-5af535fff47c tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:05.733269 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8d1e34a3-64a7-4cc2-be2d-5af535fff47c tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:05.739916 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d1e34a3-64a7-4cc2-be2d-5af535fff47c tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:05.740424 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d1e34a3-64a7-4cc2-be2d-5af535fff47c tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:05.741151 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d1e34a3-64a7-4cc2-be2d-5af535fff47c tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:05.741760 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d1e34a3-64a7-4cc2-be2d-5af535fff47c tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:05.750777 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-caaaac02-f890-41b8-96ea-8aa15fa2ac0a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:05.754260 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-caaaac02-f890-41b8-96ea-8aa15fa2ac0a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:05.756662 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-caaaac02-f890-41b8-96ea-8aa15fa2ac0a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.459125 Dec 23 12:02:05.756662 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 218/473] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:05 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:05.895447 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8d1e34a3-64a7-4cc2-be2d-5af535fff47c tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:05.903283 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8d1e34a3-64a7-4cc2-be2d-5af535fff47c tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.174397 Dec 23 12:02:05.903855 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 256/474] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:05 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:06.745180 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-9d2ae665-1f69-4c51-b15d-a1adf2119d90 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:06.745856 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-9d2ae665-1f69-4c51-b15d-a1adf2119d90 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:06.752877 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9d2ae665-1f69-4c51-b15d-a1adf2119d90 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:06.753344 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9d2ae665-1f69-4c51-b15d-a1adf2119d90 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:06.754129 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9d2ae665-1f69-4c51-b15d-a1adf2119d90 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:06.754560 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9d2ae665-1f69-4c51-b15d-a1adf2119d90 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:06.775384 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a2f8a319-a906-40d4-be6d-c27b9ca222af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:06.775384 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a2f8a319-a906-40d4-be6d-c27b9ca222af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:06.781893 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a2f8a319-a906-40d4-be6d-c27b9ca222af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:06.782778 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a2f8a319-a906-40d4-be6d-c27b9ca222af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:06.788075 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a2f8a319-a906-40d4-be6d-c27b9ca222af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:06.788532 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a2f8a319-a906-40d4-be6d-c27b9ca222af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:06.949694 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-9d2ae665-1f69-4c51-b15d-a1adf2119d90 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:06.958962 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-9d2ae665-1f69-4c51-b15d-a1adf2119d90 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.217315 Dec 23 12:02:06.959354 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 219/475] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:06 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:06.963817 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-484345d8-7249-42da-85c9-faca0a4500c9 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:06.964425 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-484345d8-7249-42da-85c9-faca0a4500c9 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:06.970253 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-484345d8-7249-42da-85c9-faca0a4500c9 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:06.970809 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-484345d8-7249-42da-85c9-faca0a4500c9 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:06.971628 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-484345d8-7249-42da-85c9-faca0a4500c9 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:06.972068 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-484345d8-7249-42da-85c9-faca0a4500c9 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:06.985914 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-a2f8a319-a906-40d4-be6d-c27b9ca222af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:06.994679 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-a2f8a319-a906-40d4-be6d-c27b9ca222af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:06.996445 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-a2f8a319-a906-40d4-be6d-c27b9ca222af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:06.997810 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a2f8a319-a906-40d4-be6d-c27b9ca222af tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.227712 Dec 23 12:02:06.998559 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 257/476] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:06 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:07.131808 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-484345d8-7249-42da-85c9-faca0a4500c9 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:07.140390 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-484345d8-7249-42da-85c9-faca0a4500c9 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.179970 Dec 23 12:02:07.141255 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 220/477] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:06 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:07.976857 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d8a4447c-e1f6-461f-b551-459d62a13262 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:07.977513 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d8a4447c-e1f6-461f-b551-459d62a13262 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:07.985802 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d8a4447c-e1f6-461f-b551-459d62a13262 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:07.986260 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d8a4447c-e1f6-461f-b551-459d62a13262 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:07.987192 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d8a4447c-e1f6-461f-b551-459d62a13262 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:07.987657 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d8a4447c-e1f6-461f-b551-459d62a13262 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:08.019454 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2b9d6f49-e153-4620-86e6-3de485aeb894 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:08.020091 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2b9d6f49-e153-4620-86e6-3de485aeb894 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:08.027492 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2b9d6f49-e153-4620-86e6-3de485aeb894 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:08.028754 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2b9d6f49-e153-4620-86e6-3de485aeb894 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:08.029805 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2b9d6f49-e153-4620-86e6-3de485aeb894 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:08.031192 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2b9d6f49-e153-4620-86e6-3de485aeb894 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:08.211533 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-d8a4447c-e1f6-461f-b551-459d62a13262 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:08.221674 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d8a4447c-e1f6-461f-b551-459d62a13262 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.248436 Dec 23 12:02:08.222971 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 258/478] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:07 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:08.230189 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9f881881-978a-4692-aa66-75e858f5a2be tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:08.230189 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9f881881-978a-4692-aa66-75e858f5a2be tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:08.242623 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9f881881-978a-4692-aa66-75e858f5a2be tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:08.243084 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9f881881-978a-4692-aa66-75e858f5a2be tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:08.243918 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9f881881-978a-4692-aa66-75e858f5a2be tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:08.244355 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9f881881-978a-4692-aa66-75e858f5a2be tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:08.246095 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-2b9d6f49-e153-4620-86e6-3de485aeb894 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:08.257043 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-2b9d6f49-e153-4620-86e6-3de485aeb894 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:08.259270 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-2b9d6f49-e153-4620-86e6-3de485aeb894 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:08.261093 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2b9d6f49-e153-4620-86e6-3de485aeb894 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.247254 Dec 23 12:02:08.261867 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 221/479] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:08 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:08.412473 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9f881881-978a-4692-aa66-75e858f5a2be tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:08.421899 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9f881881-978a-4692-aa66-75e858f5a2be tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.197751 Dec 23 12:02:08.423168 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 259/480] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:08 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:09.239844 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4c44db54-1db0-4ebd-a846-5ccf153a4285 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:09.240523 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4c44db54-1db0-4ebd-a846-5ccf153a4285 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:09.253148 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4c44db54-1db0-4ebd-a846-5ccf153a4285 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:09.253607 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4c44db54-1db0-4ebd-a846-5ccf153a4285 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:09.263561 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4c44db54-1db0-4ebd-a846-5ccf153a4285 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:09.264021 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4c44db54-1db0-4ebd-a846-5ccf153a4285 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:09.284088 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-287af74e-435a-467f-808f-bffe9dcd19c2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:09.287738 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-287af74e-435a-467f-808f-bffe9dcd19c2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:09.295842 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-287af74e-435a-467f-808f-bffe9dcd19c2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:09.296684 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-287af74e-435a-467f-808f-bffe9dcd19c2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:09.297699 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-287af74e-435a-467f-808f-bffe9dcd19c2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:09.298203 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-287af74e-435a-467f-808f-bffe9dcd19c2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:09.482128 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4c44db54-1db0-4ebd-a846-5ccf153a4285 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:09.490264 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-287af74e-435a-467f-808f-bffe9dcd19c2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:09.495634 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4c44db54-1db0-4ebd-a846-5ccf153a4285 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.260497 Dec 23 12:02:09.496417 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 222/481] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:09 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:09.499298 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-287af74e-435a-467f-808f-bffe9dcd19c2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:09.500786 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-287af74e-435a-467f-808f-bffe9dcd19c2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:09.501354 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b8946372-d792-4aea-8e10-6211c72e2b26 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:09.502038 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-287af74e-435a-467f-808f-bffe9dcd19c2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.222518 Dec 23 12:02:09.502264 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b8946372-d792-4aea-8e10-6211c72e2b26 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:09.512991 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 260/482] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:09 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:09.516215 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b8946372-d792-4aea-8e10-6211c72e2b26 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:09.516670 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b8946372-d792-4aea-8e10-6211c72e2b26 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:09.517647 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b8946372-d792-4aea-8e10-6211c72e2b26 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:09.518295 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b8946372-d792-4aea-8e10-6211c72e2b26 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:09.664247 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b8946372-d792-4aea-8e10-6211c72e2b26 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:09.671795 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b8946372-d792-4aea-8e10-6211c72e2b26 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.174251 Dec 23 12:02:09.672352 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 223/483] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:09 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:10.517191 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c1b0fa8b-1f79-4a3e-934e-6d677e0ae19a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:10.518753 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c1b0fa8b-1f79-4a3e-934e-6d677e0ae19a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:10.522043 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-219f2b5b-6afe-4eb8-944d-274e746775c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:10.523235 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-219f2b5b-6afe-4eb8-944d-274e746775c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:10.527849 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c1b0fa8b-1f79-4a3e-934e-6d677e0ae19a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:10.528303 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c1b0fa8b-1f79-4a3e-934e-6d677e0ae19a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:10.529101 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c1b0fa8b-1f79-4a3e-934e-6d677e0ae19a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:10.529580 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c1b0fa8b-1f79-4a3e-934e-6d677e0ae19a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:10.529893 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-219f2b5b-6afe-4eb8-944d-274e746775c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:10.530345 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-219f2b5b-6afe-4eb8-944d-274e746775c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:10.531158 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-219f2b5b-6afe-4eb8-944d-274e746775c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:10.531684 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-219f2b5b-6afe-4eb8-944d-274e746775c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:10.728444 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c1b0fa8b-1f79-4a3e-934e-6d677e0ae19a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:10.738658 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c1b0fa8b-1f79-4a3e-934e-6d677e0ae19a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.227945 Dec 23 12:02:10.739249 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 261/484] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:10 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:10.743781 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1e34832e-a7ad-447e-8b45-f63ab5dfbd42 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:10.744590 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1e34832e-a7ad-447e-8b45-f63ab5dfbd42 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:10.750220 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1e34832e-a7ad-447e-8b45-f63ab5dfbd42 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:10.750714 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1e34832e-a7ad-447e-8b45-f63ab5dfbd42 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:10.751501 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1e34832e-a7ad-447e-8b45-f63ab5dfbd42 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:10.751942 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1e34832e-a7ad-447e-8b45-f63ab5dfbd42 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:10.754699 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-219f2b5b-6afe-4eb8-944d-274e746775c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:10.762934 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-219f2b5b-6afe-4eb8-944d-274e746775c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:10.764418 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-219f2b5b-6afe-4eb8-944d-274e746775c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:10.765583 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-219f2b5b-6afe-4eb8-944d-274e746775c8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.247813 Dec 23 12:02:10.766145 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 224/485] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:10 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:10.888847 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1e34832e-a7ad-447e-8b45-f63ab5dfbd42 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:10.897267 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1e34832e-a7ad-447e-8b45-f63ab5dfbd42 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.156733 Dec 23 12:02:10.897845 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 262/486] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:10 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:11.756309 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c82c1d05-1338-4de8-9137-273ede39ad78 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:11.756907 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c82c1d05-1338-4de8-9137-273ede39ad78 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:11.763914 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c82c1d05-1338-4de8-9137-273ede39ad78 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:11.764374 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c82c1d05-1338-4de8-9137-273ede39ad78 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:11.765163 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c82c1d05-1338-4de8-9137-273ede39ad78 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:11.765604 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c82c1d05-1338-4de8-9137-273ede39ad78 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:11.784878 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-af7917b0-15c9-4372-8b23-07a52d2698a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:11.786211 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-af7917b0-15c9-4372-8b23-07a52d2698a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:11.793647 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-af7917b0-15c9-4372-8b23-07a52d2698a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:11.794455 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-af7917b0-15c9-4372-8b23-07a52d2698a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:11.795594 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-af7917b0-15c9-4372-8b23-07a52d2698a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:11.796264 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-af7917b0-15c9-4372-8b23-07a52d2698a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:11.980720 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c82c1d05-1338-4de8-9137-273ede39ad78 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:11.988504 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-af7917b0-15c9-4372-8b23-07a52d2698a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:11.991923 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c82c1d05-1338-4de8-9137-273ede39ad78 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.239489 Dec 23 12:02:11.992508 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 225/487] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:11 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:11.996972 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e873850c-3d74-41a0-bd2d-dd69bfc74ad8 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:11.997581 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e873850c-3d74-41a0-bd2d-dd69bfc74ad8 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:11.998056 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-af7917b0-15c9-4372-8b23-07a52d2698a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:11.999735 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-af7917b0-15c9-4372-8b23-07a52d2698a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:12.001017 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-af7917b0-15c9-4372-8b23-07a52d2698a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.220153 Dec 23 12:02:12.001746 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 263/488] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:11 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:12.004690 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e873850c-3d74-41a0-bd2d-dd69bfc74ad8 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:12.005769 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e873850c-3d74-41a0-bd2d-dd69bfc74ad8 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:12.006973 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e873850c-3d74-41a0-bd2d-dd69bfc74ad8 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:12.007431 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e873850c-3d74-41a0-bd2d-dd69bfc74ad8 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:12.148946 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e873850c-3d74-41a0-bd2d-dd69bfc74ad8 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:12.156484 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e873850c-3d74-41a0-bd2d-dd69bfc74ad8 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.162874 Dec 23 12:02:12.157042 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 226/489] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:11 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:13.008838 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c63eb269-a2d4-458e-b72b-c4771119302c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:13.009379 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c63eb269-a2d4-458e-b72b-c4771119302c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:13.017625 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c63eb269-a2d4-458e-b72b-c4771119302c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:13.018085 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c63eb269-a2d4-458e-b72b-c4771119302c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:13.018903 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c63eb269-a2d4-458e-b72b-c4771119302c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:13.019336 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c63eb269-a2d4-458e-b72b-c4771119302c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:13.019504 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3ba6028d-319c-458e-a6ba-52112d4f6b87 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:13.019956 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3ba6028d-319c-458e-a6ba-52112d4f6b87 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:13.026816 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3ba6028d-319c-458e-a6ba-52112d4f6b87 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:13.027272 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3ba6028d-319c-458e-a6ba-52112d4f6b87 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:13.028093 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3ba6028d-319c-458e-a6ba-52112d4f6b87 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:13.028537 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3ba6028d-319c-458e-a6ba-52112d4f6b87 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:13.220855 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c63eb269-a2d4-458e-b72b-c4771119302c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:13.225058 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3ba6028d-319c-458e-a6ba-52112d4f6b87 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:13.229429 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c63eb269-a2d4-458e-b72b-c4771119302c tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.224501 Dec 23 12:02:13.230000 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 264/490] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:13 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:13.234223 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f78ed911-ade7-4def-a72b-bdb076574479 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:13.234847 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f78ed911-ade7-4def-a72b-bdb076574479 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:13.238572 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3ba6028d-319c-458e-a6ba-52112d4f6b87 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:13.240566 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3ba6028d-319c-458e-a6ba-52112d4f6b87 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:13.240898 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f78ed911-ade7-4def-a72b-bdb076574479 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:13.241348 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f78ed911-ade7-4def-a72b-bdb076574479 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:13.241774 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3ba6028d-319c-458e-a6ba-52112d4f6b87 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.226110 Dec 23 12:02:13.242128 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f78ed911-ade7-4def-a72b-bdb076574479 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:13.242331 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 227/491] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:13 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:13.242609 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f78ed911-ade7-4def-a72b-bdb076574479 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:13.389076 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f78ed911-ade7-4def-a72b-bdb076574479 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:13.396765 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f78ed911-ade7-4def-a72b-bdb076574479 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.165679 Dec 23 12:02:13.397372 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 265/492] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:13 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:14.251253 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-75044e09-2b10-40c2-97ef-4f9115857def tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:14.252556 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-75044e09-2b10-40c2-97ef-4f9115857def tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:14.262290 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7ad06c3e-23dc-42e1-830a-b933919deabc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:14.263839 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-7ad06c3e-23dc-42e1-830a-b933919deabc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:14.264157 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-75044e09-2b10-40c2-97ef-4f9115857def tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:14.264689 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-75044e09-2b10-40c2-97ef-4f9115857def tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:14.265558 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-75044e09-2b10-40c2-97ef-4f9115857def tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:14.266062 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-75044e09-2b10-40c2-97ef-4f9115857def tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:14.274457 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7ad06c3e-23dc-42e1-830a-b933919deabc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:14.274943 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7ad06c3e-23dc-42e1-830a-b933919deabc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:14.275751 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7ad06c3e-23dc-42e1-830a-b933919deabc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:14.276190 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7ad06c3e-23dc-42e1-830a-b933919deabc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:14.467830 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-75044e09-2b10-40c2-97ef-4f9115857def tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:14.472047 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-7ad06c3e-23dc-42e1-830a-b933919deabc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:14.476411 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-75044e09-2b10-40c2-97ef-4f9115857def tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.231855 Dec 23 12:02:14.476985 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 228/493] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:14 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:14.481456 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-7ad06c3e-23dc-42e1-830a-b933919deabc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:14.481965 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-bcd4a051-5df0-46e0-be0e-fd058a5d67ab tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:14.482587 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-bcd4a051-5df0-46e0-be0e-fd058a5d67ab tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:14.482931 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-7ad06c3e-23dc-42e1-830a-b933919deabc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:14.485877 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-7ad06c3e-23dc-42e1-830a-b933919deabc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.226946 Dec 23 12:02:14.485877 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 266/494] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:14 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:14.490392 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bcd4a051-5df0-46e0-be0e-fd058a5d67ab tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:14.490392 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bcd4a051-5df0-46e0-be0e-fd058a5d67ab tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:14.491308 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bcd4a051-5df0-46e0-be0e-fd058a5d67ab tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:14.491747 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bcd4a051-5df0-46e0-be0e-fd058a5d67ab tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:14.628311 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-bcd4a051-5df0-46e0-be0e-fd058a5d67ab tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:14.636091 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-bcd4a051-5df0-46e0-be0e-fd058a5d67ab tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.158135 Dec 23 12:02:14.636610 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 229/495] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:14 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:15.493339 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c8613cd1-514a-49eb-9e7f-99cc52e22c1f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:15.493991 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c8613cd1-514a-49eb-9e7f-99cc52e22c1f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:15.500808 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c8613cd1-514a-49eb-9e7f-99cc52e22c1f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:15.501255 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c8613cd1-514a-49eb-9e7f-99cc52e22c1f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:15.502033 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c8613cd1-514a-49eb-9e7f-99cc52e22c1f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:15.502461 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c8613cd1-514a-49eb-9e7f-99cc52e22c1f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:15.503091 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ac6d64f0-bf56-48ea-8a6f-8449a0df26da tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:15.503708 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ac6d64f0-bf56-48ea-8a6f-8449a0df26da tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:15.510071 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ac6d64f0-bf56-48ea-8a6f-8449a0df26da tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:15.510544 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ac6d64f0-bf56-48ea-8a6f-8449a0df26da tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:15.511334 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ac6d64f0-bf56-48ea-8a6f-8449a0df26da tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:15.511772 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ac6d64f0-bf56-48ea-8a6f-8449a0df26da tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:15.711909 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c8613cd1-514a-49eb-9e7f-99cc52e22c1f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:15.715135 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ac6d64f0-bf56-48ea-8a6f-8449a0df26da tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:15.719885 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c8613cd1-514a-49eb-9e7f-99cc52e22c1f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.230319 Dec 23 12:02:15.720515 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 267/496] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:15 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:15.723518 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ac6d64f0-bf56-48ea-8a6f-8449a0df26da tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:15.724885 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-44734c2b-3263-4871-baf6-50b06dd5ba86 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:15.725095 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ac6d64f0-bf56-48ea-8a6f-8449a0df26da tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:15.725762 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-44734c2b-3263-4871-baf6-50b06dd5ba86 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:15.726533 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ac6d64f0-bf56-48ea-8a6f-8449a0df26da tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.227084 Dec 23 12:02:15.727252 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 230/497] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:15 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:15.731847 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-44734c2b-3263-4871-baf6-50b06dd5ba86 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:15.732368 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-44734c2b-3263-4871-baf6-50b06dd5ba86 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:15.733253 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-44734c2b-3263-4871-baf6-50b06dd5ba86 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:15.733785 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-44734c2b-3263-4871-baf6-50b06dd5ba86 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:15.874657 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-44734c2b-3263-4871-baf6-50b06dd5ba86 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:15.882689 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-44734c2b-3263-4871-baf6-50b06dd5ba86 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.160997 Dec 23 12:02:15.883572 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 268/498] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:15 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:16.743135 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-58a9d30d-8743-422e-b536-2041fab77611 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:16.744186 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-58a9d30d-8743-422e-b536-2041fab77611 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:16.749022 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e03bc0bc-c91b-4e01-8754-8dfb30ffe9ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:16.750016 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e03bc0bc-c91b-4e01-8754-8dfb30ffe9ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:16.755108 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-58a9d30d-8743-422e-b536-2041fab77611 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:16.755841 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-58a9d30d-8743-422e-b536-2041fab77611 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:16.757687 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-58a9d30d-8743-422e-b536-2041fab77611 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:16.758140 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-58a9d30d-8743-422e-b536-2041fab77611 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:16.759530 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e03bc0bc-c91b-4e01-8754-8dfb30ffe9ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:16.759961 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e03bc0bc-c91b-4e01-8754-8dfb30ffe9ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:16.760773 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e03bc0bc-c91b-4e01-8754-8dfb30ffe9ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:16.761318 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e03bc0bc-c91b-4e01-8754-8dfb30ffe9ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:16.959481 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-58a9d30d-8743-422e-b536-2041fab77611 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:16.964466 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e03bc0bc-c91b-4e01-8754-8dfb30ffe9ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:16.968988 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-58a9d30d-8743-422e-b536-2041fab77611 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.232471 Dec 23 12:02:16.969559 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 231/499] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:16 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:16.973719 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e2af6085-ef42-4484-a014-2192b03c2da9 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:16.974353 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e2af6085-ef42-4484-a014-2192b03c2da9 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:16.979805 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e03bc0bc-c91b-4e01-8754-8dfb30ffe9ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:16.980163 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e2af6085-ef42-4484-a014-2192b03c2da9 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:16.980618 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e2af6085-ef42-4484-a014-2192b03c2da9 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:16.981290 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e03bc0bc-c91b-4e01-8754-8dfb30ffe9ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:16.981442 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e2af6085-ef42-4484-a014-2192b03c2da9 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:16.981818 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e2af6085-ef42-4484-a014-2192b03c2da9 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:16.982489 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e03bc0bc-c91b-4e01-8754-8dfb30ffe9ad tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.239739 Dec 23 12:02:16.983043 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 269/500] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:16 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:17.122646 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e2af6085-ef42-4484-a014-2192b03c2da9 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:17.130456 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e2af6085-ef42-4484-a014-2192b03c2da9 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.159945 Dec 23 12:02:17.131064 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 232/501] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:16 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:17.985401 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-72388eff-d1a4-442c-a058-ecc957b8fad6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:17.986087 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-72388eff-d1a4-442c-a058-ecc957b8fad6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:17.992899 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-72388eff-d1a4-442c-a058-ecc957b8fad6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:17.993356 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-72388eff-d1a4-442c-a058-ecc957b8fad6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:17.994149 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-72388eff-d1a4-442c-a058-ecc957b8fad6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:17.994626 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-72388eff-d1a4-442c-a058-ecc957b8fad6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:18.001528 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0ad792bf-9622-47ac-bca9-e75cfe4b140e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:18.002148 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0ad792bf-9622-47ac-bca9-e75cfe4b140e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:18.009422 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0ad792bf-9622-47ac-bca9-e75cfe4b140e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:18.009857 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0ad792bf-9622-47ac-bca9-e75cfe4b140e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:18.010880 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0ad792bf-9622-47ac-bca9-e75cfe4b140e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:18.011328 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0ad792bf-9622-47ac-bca9-e75cfe4b140e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:18.192916 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-72388eff-d1a4-442c-a058-ecc957b8fad6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:18.199677 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0ad792bf-9622-47ac-bca9-e75cfe4b140e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:18.201330 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-72388eff-d1a4-442c-a058-ecc957b8fad6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.219899 Dec 23 12:02:18.201882 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 270/502] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:17 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:18.206128 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-75f0b323-61e2-400a-a700-580bbca8b222 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:18.206781 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-75f0b323-61e2-400a-a700-580bbca8b222 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:18.208521 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0ad792bf-9622-47ac-bca9-e75cfe4b140e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:18.210050 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0ad792bf-9622-47ac-bca9-e75cfe4b140e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:18.211258 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0ad792bf-9622-47ac-bca9-e75cfe4b140e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.213466 Dec 23 12:02:18.211800 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 233/503] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:17 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:18.212568 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-75f0b323-61e2-400a-a700-580bbca8b222 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:18.213025 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-75f0b323-61e2-400a-a700-580bbca8b222 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:18.213806 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-75f0b323-61e2-400a-a700-580bbca8b222 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:18.214241 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-75f0b323-61e2-400a-a700-580bbca8b222 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:18.348177 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-75f0b323-61e2-400a-a700-580bbca8b222 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:18.357820 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-75f0b323-61e2-400a-a700-580bbca8b222 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.154920 Dec 23 12:02:18.358399 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 271/504] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:18 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:19.222860 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-09c4a3f8-89d3-4b89-abaa-c97cdba29f15 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:19.223840 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-09c4a3f8-89d3-4b89-abaa-c97cdba29f15 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:19.233072 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4ed0907e-86ee-4f75-ac44-17f207bfb1c3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:19.234987 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4ed0907e-86ee-4f75-ac44-17f207bfb1c3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:19.235798 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-09c4a3f8-89d3-4b89-abaa-c97cdba29f15 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:19.236522 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-09c4a3f8-89d3-4b89-abaa-c97cdba29f15 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:19.237848 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-09c4a3f8-89d3-4b89-abaa-c97cdba29f15 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:19.238594 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-09c4a3f8-89d3-4b89-abaa-c97cdba29f15 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:19.244354 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4ed0907e-86ee-4f75-ac44-17f207bfb1c3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:19.244883 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4ed0907e-86ee-4f75-ac44-17f207bfb1c3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:19.246597 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4ed0907e-86ee-4f75-ac44-17f207bfb1c3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:19.247357 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4ed0907e-86ee-4f75-ac44-17f207bfb1c3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:19.443907 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-09c4a3f8-89d3-4b89-abaa-c97cdba29f15 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:19.451749 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4ed0907e-86ee-4f75-ac44-17f207bfb1c3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:19.452222 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-09c4a3f8-89d3-4b89-abaa-c97cdba29f15 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.235530 Dec 23 12:02:19.453145 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 234/505] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:19 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:19.457752 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d57b07af-815f-443c-b7af-e387b9d54436 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:19.458368 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d57b07af-815f-443c-b7af-e387b9d54436 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:19.465211 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d57b07af-815f-443c-b7af-e387b9d54436 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:19.465613 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4ed0907e-86ee-4f75-ac44-17f207bfb1c3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:19.465813 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d57b07af-815f-443c-b7af-e387b9d54436 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:19.466473 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d57b07af-815f-443c-b7af-e387b9d54436 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:19.467212 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d57b07af-815f-443c-b7af-e387b9d54436 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:19.468028 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4ed0907e-86ee-4f75-ac44-17f207bfb1c3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:19.470052 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4ed0907e-86ee-4f75-ac44-17f207bfb1c3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.242646 Dec 23 12:02:19.470840 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 272/506] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:19 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:02:19.603839 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d57b07af-815f-443c-b7af-e387b9d54436 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:19.611705 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d57b07af-815f-443c-b7af-e387b9d54436 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.157730 Dec 23 12:02:19.612295 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 235/507] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:19 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:20.474765 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d852d601-374d-44d4-91d8-9fe7922098d0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:20.475781 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d852d601-374d-44d4-91d8-9fe7922098d0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:20.483356 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d852d601-374d-44d4-91d8-9fe7922098d0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:20.483837 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d852d601-374d-44d4-91d8-9fe7922098d0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:20.484647 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d852d601-374d-44d4-91d8-9fe7922098d0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:20.485474 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d852d601-374d-44d4-91d8-9fe7922098d0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:20.492466 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2d97cc03-c92e-4cc8-9825-f463e32b9d1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:20.493113 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2d97cc03-c92e-4cc8-9825-f463e32b9d1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:20.499754 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2d97cc03-c92e-4cc8-9825-f463e32b9d1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:20.500224 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2d97cc03-c92e-4cc8-9825-f463e32b9d1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:20.501032 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2d97cc03-c92e-4cc8-9825-f463e32b9d1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:20.501485 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2d97cc03-c92e-4cc8-9825-f463e32b9d1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:20.690994 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-d852d601-374d-44d4-91d8-9fe7922098d0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:20.697630 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-2d97cc03-c92e-4cc8-9825-f463e32b9d1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:20.699931 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d852d601-374d-44d4-91d8-9fe7922098d0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.231486 Dec 23 12:02:20.701051 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 273/508] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:20 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:20.705394 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-28309000-299d-472b-9459-a5f557b9b3ce tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:20.705999 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-28309000-299d-472b-9459-a5f557b9b3ce tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:20.706114 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-2d97cc03-c92e-4cc8-9825-f463e32b9d1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:20.707530 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-2d97cc03-c92e-4cc8-9825-f463e32b9d1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:20.708729 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2d97cc03-c92e-4cc8-9825-f463e32b9d1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.220305 Dec 23 12:02:20.709250 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 236/509] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:20 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:20.712499 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-28309000-299d-472b-9459-a5f557b9b3ce tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:20.713019 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-28309000-299d-472b-9459-a5f557b9b3ce tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:20.713806 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-28309000-299d-472b-9459-a5f557b9b3ce tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:20.714220 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-28309000-299d-472b-9459-a5f557b9b3ce tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:20.737934 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-f1df4cb6-ecc7-4b5c-855c-097f00eab77d req-b9a344d6-9b3f-44d2-bbe5-bcbf0e594ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d087055b-27de-4c01-962a-5744a4c4cd7d", "name": "network-vif-plugged", "status": "completed", "tag": "ec4101a7-3a3b-4137-ac8f-4d9146a15ac1"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:02:20.739878 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:02:20.739878 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:02:20.747587 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-f1df4cb6-ecc7-4b5c-855c-097f00eab77d req-b9a344d6-9b3f-44d2-bbe5-bcbf0e594ba7 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:20.748143 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-f1df4cb6-ecc7-4b5c-855c-097f00eab77d req-b9a344d6-9b3f-44d2-bbe5-bcbf0e594ba7 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:20.760171 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-f1df4cb6-ecc7-4b5c-855c-097f00eab77d req-b9a344d6-9b3f-44d2-bbe5-bcbf0e594ba7 service nova] Creating event network-vif-plugged:ec4101a7-3a3b-4137-ac8f-4d9146a15ac1 for instance d087055b-27de-4c01-962a-5744a4c4cd7d on hv-cinder-82282 Dec 23 12:02:20.765242 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-f1df4cb6-ecc7-4b5c-855c-097f00eab77d req-b9a344d6-9b3f-44d2-bbe5-bcbf0e594ba7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031250 Dec 23 12:02:20.765851 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 237/510] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:02:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 12:02:20.849101 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-28309000-299d-472b-9459-a5f557b9b3ce tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:20.856828 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-28309000-299d-472b-9459-a5f557b9b3ce tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.154665 Dec 23 12:02:20.857419 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 274/511] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:20 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:21.722379 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-fd7432ff-794d-41f6-b41f-4feb18e011e2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:21.723595 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-fd7432ff-794d-41f6-b41f-4feb18e011e2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:21.729316 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-23354caf-01a6-4842-82c1-fb5b91f434a0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:21.729932 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-23354caf-01a6-4842-82c1-fb5b91f434a0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:21.731525 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fd7432ff-794d-41f6-b41f-4feb18e011e2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:21.732006 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fd7432ff-794d-41f6-b41f-4feb18e011e2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:21.732801 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fd7432ff-794d-41f6-b41f-4feb18e011e2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:21.733241 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fd7432ff-794d-41f6-b41f-4feb18e011e2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:21.738609 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-23354caf-01a6-4842-82c1-fb5b91f434a0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:21.738609 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-23354caf-01a6-4842-82c1-fb5b91f434a0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:21.738609 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-23354caf-01a6-4842-82c1-fb5b91f434a0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:21.738935 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-23354caf-01a6-4842-82c1-fb5b91f434a0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:21.925384 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-fd7432ff-794d-41f6-b41f-4feb18e011e2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:21.928667 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-23354caf-01a6-4842-82c1-fb5b91f434a0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:21.934154 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-fd7432ff-794d-41f6-b41f-4feb18e011e2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.219357 Dec 23 12:02:21.934795 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 238/512] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:21 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:21.937451 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-23354caf-01a6-4842-82c1-fb5b91f434a0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:21.939019 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5ad1138f-83d5-4835-8ba1-939f834f6160 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:21.939150 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-23354caf-01a6-4842-82c1-fb5b91f434a0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:21.939632 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5ad1138f-83d5-4835-8ba1-939f834f6160 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:21.940496 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-23354caf-01a6-4842-82c1-fb5b91f434a0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.215647 Dec 23 12:02:21.941473 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 275/513] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:21 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:21.945931 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5ad1138f-83d5-4835-8ba1-939f834f6160 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:21.946388 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5ad1138f-83d5-4835-8ba1-939f834f6160 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:21.947215 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5ad1138f-83d5-4835-8ba1-939f834f6160 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:21.947657 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5ad1138f-83d5-4835-8ba1-939f834f6160 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:22.105618 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-5ad1138f-83d5-4835-8ba1-939f834f6160 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:22.113511 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5ad1138f-83d5-4835-8ba1-939f834f6160 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.177693 Dec 23 12:02:22.114081 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 239/514] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:21 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:22.953920 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-6f30e242-040e-42c4-b119-99ded6fd00a5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:22.954658 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-6f30e242-040e-42c4-b119-99ded6fd00a5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:22.960584 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-10604839-4ab9-4167-bd12-8cd1b6d19cd3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:22.961998 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-10604839-4ab9-4167-bd12-8cd1b6d19cd3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:22.963340 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6f30e242-040e-42c4-b119-99ded6fd00a5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:22.963805 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6f30e242-040e-42c4-b119-99ded6fd00a5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:22.964583 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6f30e242-040e-42c4-b119-99ded6fd00a5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:22.965059 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6f30e242-040e-42c4-b119-99ded6fd00a5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:22.969311 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-10604839-4ab9-4167-bd12-8cd1b6d19cd3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:22.969768 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-10604839-4ab9-4167-bd12-8cd1b6d19cd3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:22.970609 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-10604839-4ab9-4167-bd12-8cd1b6d19cd3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:22.971049 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-10604839-4ab9-4167-bd12-8cd1b6d19cd3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:23.173010 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-6f30e242-040e-42c4-b119-99ded6fd00a5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:23.176506 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-10604839-4ab9-4167-bd12-8cd1b6d19cd3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:23.181519 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-6f30e242-040e-42c4-b119-99ded6fd00a5 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.232552 Dec 23 12:02:23.182086 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 276/515] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:22 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:23.185991 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-10604839-4ab9-4167-bd12-8cd1b6d19cd3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:23.186399 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ad7b86ce-7c4d-4865-a479-ccc2ea78ccf6 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:23.187044 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ad7b86ce-7c4d-4865-a479-ccc2ea78ccf6 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:23.187499 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-10604839-4ab9-4167-bd12-8cd1b6d19cd3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:23.193119 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ad7b86ce-7c4d-4865-a479-ccc2ea78ccf6 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:23.193571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ad7b86ce-7c4d-4865-a479-ccc2ea78ccf6 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:23.194346 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ad7b86ce-7c4d-4865-a479-ccc2ea78ccf6 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:23.194812 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ad7b86ce-7c4d-4865-a479-ccc2ea78ccf6 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:23.198700 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-10604839-4ab9-4167-bd12-8cd1b6d19cd3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.233411 Dec 23 12:02:23.199315 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 240/516] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:22 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:23.340531 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ad7b86ce-7c4d-4865-a479-ccc2ea78ccf6 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:23.351533 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ad7b86ce-7c4d-4865-a479-ccc2ea78ccf6 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1260 microversion: 2.1 time: 0.168123 Dec 23 12:02:23.353031 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 277/517] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:23 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:24.202399 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-68ec9cd1-05eb-48ec-8d43-b659feb0a76e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:24.206426 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-68ec9cd1-05eb-48ec-8d43-b659feb0a76e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:24.214577 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-68ec9cd1-05eb-48ec-8d43-b659feb0a76e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:24.215359 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-68ec9cd1-05eb-48ec-8d43-b659feb0a76e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:24.216677 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-68ec9cd1-05eb-48ec-8d43-b659feb0a76e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:24.217412 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-68ec9cd1-05eb-48ec-8d43-b659feb0a76e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:24.220552 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-57707bf4-2d1b-438a-8c23-b8bbc1d5e9ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:24.221571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-57707bf4-2d1b-438a-8c23-b8bbc1d5e9ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:24.231518 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-57707bf4-2d1b-438a-8c23-b8bbc1d5e9ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:24.231979 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-57707bf4-2d1b-438a-8c23-b8bbc1d5e9ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:24.232837 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-57707bf4-2d1b-438a-8c23-b8bbc1d5e9ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:24.233528 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-57707bf4-2d1b-438a-8c23-b8bbc1d5e9ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:24.422695 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-68ec9cd1-05eb-48ec-8d43-b659feb0a76e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:24.429930 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-57707bf4-2d1b-438a-8c23-b8bbc1d5e9ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:24.430812 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-68ec9cd1-05eb-48ec-8d43-b659feb0a76e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.234601 Dec 23 12:02:24.431601 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 241/518] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:24 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:24.435854 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e13c438e-497f-4b73-b31c-dd6a4db776a8 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:24.436468 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e13c438e-497f-4b73-b31c-dd6a4db776a8 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:24.439138 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-57707bf4-2d1b-438a-8c23-b8bbc1d5e9ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:24.440652 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-57707bf4-2d1b-438a-8c23-b8bbc1d5e9ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:24.441775 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-57707bf4-2d1b-438a-8c23-b8bbc1d5e9ac tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.227480 Dec 23 12:02:24.442354 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 278/519] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:24 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:24.446348 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e13c438e-497f-4b73-b31c-dd6a4db776a8 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:24.446910 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e13c438e-497f-4b73-b31c-dd6a4db776a8 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:24.447774 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e13c438e-497f-4b73-b31c-dd6a4db776a8 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:24.448250 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e13c438e-497f-4b73-b31c-dd6a4db776a8 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:24.587208 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e13c438e-497f-4b73-b31c-dd6a4db776a8 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:24.595873 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e13c438e-497f-4b73-b31c-dd6a4db776a8 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1444 microversion: 2.1 time: 0.163270 Dec 23 12:02:24.596687 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 242/520] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:24 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:24.613319 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b3b04ebf-0bf4-413f-9ece-244dd136166b tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:24.614143 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b3b04ebf-0bf4-413f-9ece-244dd136166b tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:24.621009 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b3b04ebf-0bf4-413f-9ece-244dd136166b tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:24.621530 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b3b04ebf-0bf4-413f-9ece-244dd136166b tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:24.622406 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b3b04ebf-0bf4-413f-9ece-244dd136166b tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:24.622981 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b3b04ebf-0bf4-413f-9ece-244dd136166b tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:24.760745 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-b3b04ebf-0bf4-413f-9ece-244dd136166b tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:24.768308 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b3b04ebf-0bf4-413f-9ece-244dd136166b tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1444 microversion: 2.1 time: 0.158989 Dec 23 12:02:24.768884 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 279/521] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:24 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:25.407521 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-7fef20d1-b1c2-4c62-b1ca-03f727821a64 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20966fae-ca88-46a0-acb3-05b15d461f17", "device": "/dev/sdb"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:02:25.409793 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-7fef20d1-b1c2-4c62-b1ca-03f727821a64 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:25.416380 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7fef20d1-b1c2-4c62-b1ca-03f727821a64 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:25.417115 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7fef20d1-b1c2-4c62-b1ca-03f727821a64 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:25.418158 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7fef20d1-b1c2-4c62-b1ca-03f727821a64 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:25.418713 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7fef20d1-b1c2-4c62-b1ca-03f727821a64 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:25.450738 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-85ff3952-fae6-4d61-b24e-0d184fd487a3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:25.452325 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-85ff3952-fae6-4d61-b24e-0d184fd487a3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:25.464201 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-85ff3952-fae6-4d61-b24e-0d184fd487a3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:25.464644 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-85ff3952-fae6-4d61-b24e-0d184fd487a3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:25.465643 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-85ff3952-fae6-4d61-b24e-0d184fd487a3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:25.467099 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-85ff3952-fae6-4d61-b24e-0d184fd487a3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:25.729170 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-7fef20d1-b1c2-4c62-b1ca-03f727821a64 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "POST /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327519 Dec 23 12:02:25.729808 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 243/522] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Dec 23 12:02:25 2021] POST /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 12:02:25.745792 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-edc1ebf8-fce8-4bd9-99be-ceef2379199c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:25.746774 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-edc1ebf8-fce8-4bd9-99be-ceef2379199c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:25.749788 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-85ff3952-fae6-4d61-b24e-0d184fd487a3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:25.755069 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-edc1ebf8-fce8-4bd9-99be-ceef2379199c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:25.755783 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-edc1ebf8-fce8-4bd9-99be-ceef2379199c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:25.756779 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-edc1ebf8-fce8-4bd9-99be-ceef2379199c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:25.757195 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-edc1ebf8-fce8-4bd9-99be-ceef2379199c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:25.760792 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-85ff3952-fae6-4d61-b24e-0d184fd487a3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.315652 Dec 23 12:02:25.761363 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 280/523] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:25 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:02:26.340201 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-edc1ebf8-fce8-4bd9-99be-ceef2379199c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:26.348668 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-edc1ebf8-fce8-4bd9-99be-ceef2379199c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:26.350196 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-edc1ebf8-fce8-4bd9-99be-ceef2379199c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:26.351389 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-edc1ebf8-fce8-4bd9-99be-ceef2379199c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.612072 Dec 23 12:02:26.352160 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 244/524] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:25 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:26.778214 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2dcf9c10-cda9-4ed0-9d42-24d759b9e581 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:26.778869 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2dcf9c10-cda9-4ed0-9d42-24d759b9e581 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:26.785877 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2dcf9c10-cda9-4ed0-9d42-24d759b9e581 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:26.786463 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2dcf9c10-cda9-4ed0-9d42-24d759b9e581 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:26.787279 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2dcf9c10-cda9-4ed0-9d42-24d759b9e581 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:26.787724 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2dcf9c10-cda9-4ed0-9d42-24d759b9e581 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:27.033195 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2dcf9c10-cda9-4ed0-9d42-24d759b9e581 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:27.045645 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2dcf9c10-cda9-4ed0-9d42-24d759b9e581 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.271966 Dec 23 12:02:27.046221 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 281/525] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:26 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:27.207626 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-7e2e9626-5868-4335-9797-06d3f43e5974 req-4e72d936-77c1-45f3-ab9e-d2fd8bc337c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d087055b-27de-4c01-962a-5744a4c4cd7d", "tag": "ec4101a7-3a3b-4137-ac8f-4d9146a15ac1"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:02:27.209587 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:02:27.209587 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:02:27.218028 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-7e2e9626-5868-4335-9797-06d3f43e5974 req-4e72d936-77c1-45f3-ab9e-d2fd8bc337c3 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:27.218602 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-7e2e9626-5868-4335-9797-06d3f43e5974 req-4e72d936-77c1-45f3-ab9e-d2fd8bc337c3 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:27.231051 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-7e2e9626-5868-4335-9797-06d3f43e5974 req-4e72d936-77c1-45f3-ab9e-d2fd8bc337c3 service nova] Creating event network-changed:ec4101a7-3a3b-4137-ac8f-4d9146a15ac1 for instance d087055b-27de-4c01-962a-5744a4c4cd7d on hv-cinder-82282 Dec 23 12:02:27.236525 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-7e2e9626-5868-4335-9797-06d3f43e5974 req-4e72d936-77c1-45f3-ab9e-d2fd8bc337c3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033147 Dec 23 12:02:27.237130 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 245/526] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:02:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:02:27.370866 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-86e51398-1e24-44ea-b97f-108fded0b52e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:27.371610 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-86e51398-1e24-44ea-b97f-108fded0b52e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:27.377692 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-86e51398-1e24-44ea-b97f-108fded0b52e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:27.378375 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-86e51398-1e24-44ea-b97f-108fded0b52e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:27.379293 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-86e51398-1e24-44ea-b97f-108fded0b52e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:27.379933 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-86e51398-1e24-44ea-b97f-108fded0b52e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:27.627903 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-86e51398-1e24-44ea-b97f-108fded0b52e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:27.637075 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-86e51398-1e24-44ea-b97f-108fded0b52e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:27.638902 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-86e51398-1e24-44ea-b97f-108fded0b52e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:27.640083 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-86e51398-1e24-44ea-b97f-108fded0b52e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.273148 Dec 23 12:02:27.640889 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 282/527] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:27 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:28.063607 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8923df13-6923-43c0-8e50-e1a7c41b011f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:28.064422 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-8923df13-6923-43c0-8e50-e1a7c41b011f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:28.071323 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8923df13-6923-43c0-8e50-e1a7c41b011f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:28.071781 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8923df13-6923-43c0-8e50-e1a7c41b011f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:28.072638 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8923df13-6923-43c0-8e50-e1a7c41b011f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:28.073090 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8923df13-6923-43c0-8e50-e1a7c41b011f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:28.214034 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-8923df13-6923-43c0-8e50-e1a7c41b011f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:28.222349 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-8923df13-6923-43c0-8e50-e1a7c41b011f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.163010 Dec 23 12:02:28.222958 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 246/528] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:28 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:28.658690 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c4eb1813-ef87-4c2f-bd3d-b420f366992c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:28.659307 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c4eb1813-ef87-4c2f-bd3d-b420f366992c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:28.666543 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c4eb1813-ef87-4c2f-bd3d-b420f366992c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:28.667004 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c4eb1813-ef87-4c2f-bd3d-b420f366992c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:28.667788 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c4eb1813-ef87-4c2f-bd3d-b420f366992c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:28.668222 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c4eb1813-ef87-4c2f-bd3d-b420f366992c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:28.767367 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-a3894f2c-1b4e-4fc0-bbe7-364b833c6083 req-90206755-43f9-4542-9108-f9720ce578f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc998144-5288-467f-82de-9c1983559e40", "name": "network-vif-plugged", "status": "completed", "tag": "bbf34ca1-ab1a-4521-9402-ff6d335fe55a"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:02:28.769745 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:02:28.769745 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:02:28.777814 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-a3894f2c-1b4e-4fc0-bbe7-364b833c6083 req-90206755-43f9-4542-9108-f9720ce578f8 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:28.778260 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-a3894f2c-1b4e-4fc0-bbe7-364b833c6083 req-90206755-43f9-4542-9108-f9720ce578f8 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:28.790256 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-a3894f2c-1b4e-4fc0-bbe7-364b833c6083 req-90206755-43f9-4542-9108-f9720ce578f8 service nova] Creating event network-vif-plugged:bbf34ca1-ab1a-4521-9402-ff6d335fe55a for instance fc998144-5288-467f-82de-9c1983559e40 on hv-cinder-82282 Dec 23 12:02:28.795644 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-a3894f2c-1b4e-4fc0-bbe7-364b833c6083 req-90206755-43f9-4542-9108-f9720ce578f8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032500 Dec 23 12:02:28.796248 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 247/529] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:02:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 12:02:28.802570 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c4eb1813-ef87-4c2f-bd3d-b420f366992c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:28.812142 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c4eb1813-ef87-4c2f-bd3d-b420f366992c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:28.813725 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c4eb1813-ef87-4c2f-bd3d-b420f366992c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:28.815047 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c4eb1813-ef87-4c2f-bd3d-b420f366992c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.160172 Dec 23 12:02:28.815679 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 283/530] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:28 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:29.241104 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-32e0158f-4e99-414a-a3b3-60b31413ba52 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:29.241807 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-32e0158f-4e99-414a-a3b3-60b31413ba52 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:29.248852 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-32e0158f-4e99-414a-a3b3-60b31413ba52 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:29.249311 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-32e0158f-4e99-414a-a3b3-60b31413ba52 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:29.250088 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-32e0158f-4e99-414a-a3b3-60b31413ba52 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:29.250566 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-32e0158f-4e99-414a-a3b3-60b31413ba52 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:29.612519 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-32e0158f-4e99-414a-a3b3-60b31413ba52 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:29.621319 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-32e0158f-4e99-414a-a3b3-60b31413ba52 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.384768 Dec 23 12:02:29.621896 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 248/531] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:29 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:29.838169 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-035a3a90-ff7c-47f0-9b03-daafe56a57be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:29.838851 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-035a3a90-ff7c-47f0-9b03-daafe56a57be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:29.846318 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-035a3a90-ff7c-47f0-9b03-daafe56a57be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:29.846858 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-035a3a90-ff7c-47f0-9b03-daafe56a57be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:29.847724 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-035a3a90-ff7c-47f0-9b03-daafe56a57be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:29.848214 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-035a3a90-ff7c-47f0-9b03-daafe56a57be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:30.000526 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-035a3a90-ff7c-47f0-9b03-daafe56a57be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:30.009195 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-035a3a90-ff7c-47f0-9b03-daafe56a57be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:30.010779 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-035a3a90-ff7c-47f0-9b03-daafe56a57be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:30.011981 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-035a3a90-ff7c-47f0-9b03-daafe56a57be tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.180816 Dec 23 12:02:30.012567 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 284/532] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:29 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:30.638766 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f49cd8e4-0527-4a92-a42b-8cfba4d6ec51 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:30.639473 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f49cd8e4-0527-4a92-a42b-8cfba4d6ec51 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:30.645887 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f49cd8e4-0527-4a92-a42b-8cfba4d6ec51 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:30.646357 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f49cd8e4-0527-4a92-a42b-8cfba4d6ec51 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:30.647161 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f49cd8e4-0527-4a92-a42b-8cfba4d6ec51 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:30.647602 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f49cd8e4-0527-4a92-a42b-8cfba4d6ec51 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:30.794085 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-f49cd8e4-0527-4a92-a42b-8cfba4d6ec51 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:30.808533 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f49cd8e4-0527-4a92-a42b-8cfba4d6ec51 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.173333 Dec 23 12:02:30.809357 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 249/533] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:30 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:31.032706 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1c2aec8c-e8f7-4178-904c-2bc2f98c649f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:31.033483 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1c2aec8c-e8f7-4178-904c-2bc2f98c649f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:31.042558 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1c2aec8c-e8f7-4178-904c-2bc2f98c649f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:31.043201 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1c2aec8c-e8f7-4178-904c-2bc2f98c649f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:31.044382 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1c2aec8c-e8f7-4178-904c-2bc2f98c649f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:31.045011 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1c2aec8c-e8f7-4178-904c-2bc2f98c649f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:31.191364 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1c2aec8c-e8f7-4178-904c-2bc2f98c649f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:31.200861 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1c2aec8c-e8f7-4178-904c-2bc2f98c649f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:31.202341 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1c2aec8c-e8f7-4178-904c-2bc2f98c649f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:31.203533 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1c2aec8c-e8f7-4178-904c-2bc2f98c649f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1810 microversion: 2.20 time: 0.175998 Dec 23 12:02:31.204093 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 285/534] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:31 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:31.831020 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-cd5794b7-c861-463b-b50f-2b71d6005caf tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:31.831591 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-cd5794b7-c861-463b-b50f-2b71d6005caf tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:31.838617 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cd5794b7-c861-463b-b50f-2b71d6005caf tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:31.839086 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cd5794b7-c861-463b-b50f-2b71d6005caf tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:31.839876 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cd5794b7-c861-463b-b50f-2b71d6005caf tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:31.840318 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cd5794b7-c861-463b-b50f-2b71d6005caf tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:31.985962 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-cd5794b7-c861-463b-b50f-2b71d6005caf tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:31.994326 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-cd5794b7-c861-463b-b50f-2b71d6005caf tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.167127 Dec 23 12:02:31.994950 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 250/535] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:31 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:32.221596 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3a7f8f3c-476a-425a-a547-b4ecc6d62ad7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:32.222204 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3a7f8f3c-476a-425a-a547-b4ecc6d62ad7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:32.228692 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3a7f8f3c-476a-425a-a547-b4ecc6d62ad7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:32.229144 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3a7f8f3c-476a-425a-a547-b4ecc6d62ad7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:32.229918 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3a7f8f3c-476a-425a-a547-b4ecc6d62ad7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:32.230351 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3a7f8f3c-476a-425a-a547-b4ecc6d62ad7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:32.367512 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3a7f8f3c-476a-425a-a547-b4ecc6d62ad7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:32.377496 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3a7f8f3c-476a-425a-a547-b4ecc6d62ad7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:32.379383 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3a7f8f3c-476a-425a-a547-b4ecc6d62ad7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:32.380548 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3a7f8f3c-476a-425a-a547-b4ecc6d62ad7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1797 microversion: 2.20 time: 0.162775 Dec 23 12:02:32.381122 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 286/536] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:02:32 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1797 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:02:33.015834 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-14f5e843-29b0-4949-a2ac-5a66b88fb82d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:33.016634 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-14f5e843-29b0-4949-a2ac-5a66b88fb82d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:33.027653 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-14f5e843-29b0-4949-a2ac-5a66b88fb82d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:33.028347 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-14f5e843-29b0-4949-a2ac-5a66b88fb82d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:33.029542 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-14f5e843-29b0-4949-a2ac-5a66b88fb82d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:33.030250 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-14f5e843-29b0-4949-a2ac-5a66b88fb82d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:33.179698 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-14f5e843-29b0-4949-a2ac-5a66b88fb82d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:33.188311 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-14f5e843-29b0-4949-a2ac-5a66b88fb82d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.179062 Dec 23 12:02:33.188861 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 251/537] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:33 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:34.207797 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-cdd7b0b6-88b6-4865-b872-caafbf61501e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:34.209010 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-cdd7b0b6-88b6-4865-b872-caafbf61501e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:34.215849 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cdd7b0b6-88b6-4865-b872-caafbf61501e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:34.216288 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cdd7b0b6-88b6-4865-b872-caafbf61501e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:34.217100 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cdd7b0b6-88b6-4865-b872-caafbf61501e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:34.217512 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cdd7b0b6-88b6-4865-b872-caafbf61501e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:34.382090 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-cdd7b0b6-88b6-4865-b872-caafbf61501e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:34.391453 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-cdd7b0b6-88b6-4865-b872-caafbf61501e tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.188569 Dec 23 12:02:34.392247 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 287/538] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:34 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:35.413727 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-9081eda0-a422-462a-9dce-694bf6122438 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:35.414722 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-9081eda0-a422-462a-9dce-694bf6122438 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:35.421877 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9081eda0-a422-462a-9dce-694bf6122438 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:35.422333 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9081eda0-a422-462a-9dce-694bf6122438 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:35.423182 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9081eda0-a422-462a-9dce-694bf6122438 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:35.423628 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9081eda0-a422-462a-9dce-694bf6122438 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:35.561929 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-9081eda0-a422-462a-9dce-694bf6122438 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:35.572241 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-9081eda0-a422-462a-9dce-694bf6122438 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.164043 Dec 23 12:02:35.572823 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 252/539] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:35 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:36.591913 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-fe2018b0-e3d9-4564-af40-64e910b4b57d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:36.592820 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-fe2018b0-e3d9-4564-af40-64e910b4b57d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:36.600924 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fe2018b0-e3d9-4564-af40-64e910b4b57d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:36.601378 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fe2018b0-e3d9-4564-af40-64e910b4b57d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:36.602164 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fe2018b0-e3d9-4564-af40-64e910b4b57d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:36.602612 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fe2018b0-e3d9-4564-af40-64e910b4b57d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:36.744736 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-fe2018b0-e3d9-4564-af40-64e910b4b57d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:36.753263 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-fe2018b0-e3d9-4564-af40-64e910b4b57d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.167275 Dec 23 12:02:36.753804 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 288/540] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:36 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:37.773543 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-68ee46fb-f692-46a9-979c-3d3c7dd1de83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:37.774782 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-68ee46fb-f692-46a9-979c-3d3c7dd1de83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:37.781367 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-68ee46fb-f692-46a9-979c-3d3c7dd1de83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:37.781817 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-68ee46fb-f692-46a9-979c-3d3c7dd1de83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:37.782619 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-68ee46fb-f692-46a9-979c-3d3c7dd1de83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:37.783057 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-68ee46fb-f692-46a9-979c-3d3c7dd1de83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:37.931299 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-68ee46fb-f692-46a9-979c-3d3c7dd1de83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:37.939620 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-68ee46fb-f692-46a9-979c-3d3c7dd1de83 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.172245 Dec 23 12:02:37.940186 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 253/541] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:37 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:38.956831 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-168a22ee-94c6-465f-a709-948379364041 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:38.957453 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-168a22ee-94c6-465f-a709-948379364041 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:38.965836 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-168a22ee-94c6-465f-a709-948379364041 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:38.966453 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-168a22ee-94c6-465f-a709-948379364041 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:38.967294 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-168a22ee-94c6-465f-a709-948379364041 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:38.967733 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-168a22ee-94c6-465f-a709-948379364041 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:39.175085 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-168a22ee-94c6-465f-a709-948379364041 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:39.183602 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-168a22ee-94c6-465f-a709-948379364041 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1568 microversion: 2.1 time: 0.230382 Dec 23 12:02:39.184430 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 289/542] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:38 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:40.205255 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-1e87cc6b-be6e-4fa2-a7ab-c8e8d2280004 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:40.206212 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-1e87cc6b-be6e-4fa2-a7ab-c8e8d2280004 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:40.215348 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1e87cc6b-be6e-4fa2-a7ab-c8e8d2280004 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:40.215803 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1e87cc6b-be6e-4fa2-a7ab-c8e8d2280004 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:40.216588 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1e87cc6b-be6e-4fa2-a7ab-c8e8d2280004 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:40.217029 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1e87cc6b-be6e-4fa2-a7ab-c8e8d2280004 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:40.356572 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-1e87cc6b-be6e-4fa2-a7ab-c8e8d2280004 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:40.365297 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-1e87cc6b-be6e-4fa2-a7ab-c8e8d2280004 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1548 microversion: 2.1 time: 0.166358 Dec 23 12:02:40.365898 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 254/543] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:40 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:40.381838 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-46adaea3-a80f-46dc-9808-fc6ecbff1e31 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:40.382347 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-46adaea3-a80f-46dc-9808-fc6ecbff1e31 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:40.389171 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-46adaea3-a80f-46dc-9808-fc6ecbff1e31 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:40.389616 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-46adaea3-a80f-46dc-9808-fc6ecbff1e31 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:40.390387 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-46adaea3-a80f-46dc-9808-fc6ecbff1e31 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:40.390854 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-46adaea3-a80f-46dc-9808-fc6ecbff1e31 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:40.511252 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-46adaea3-a80f-46dc-9808-fc6ecbff1e31 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] HTTP exception thrown: Cannot 'detach_volume' instance 15f88906-0a5f-47a4-bf35-55db395a0e97 while it is in vm_state rescued Dec 23 12:02:40.511847 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-46adaea3-a80f-46dc-9808-fc6ecbff1e31 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Returning 409 to user: Cannot 'detach_volume' instance 15f88906-0a5f-47a4-bf35-55db395a0e97 while it is in vm_state rescued {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:02:40.512672 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-46adaea3-a80f-46dc-9808-fc6ecbff1e31 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "DELETE /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/os-volume_attachments/f5a4d92b-0574-49e0-b118-6628ec8c9267" status: 409 len: 152 microversion: 2.1 time: 0.134677 Dec 23 12:02:40.513215 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 290/544] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Dec 23 12:02:40 2021] DELETE /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/os-volume_attachments/f5a4d92b-0574-49e0-b118-6628ec8c9267 => generated 152 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 23 12:02:40.521628 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-1f4f3ef9-7cc2-4e5d-af8a-95b718dbae36 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:02:40.522540 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-1f4f3ef9-7cc2-4e5d-af8a-95b718dbae36 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:40.528709 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1f4f3ef9-7cc2-4e5d-af8a-95b718dbae36 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:40.529153 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1f4f3ef9-7cc2-4e5d-af8a-95b718dbae36 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:40.529912 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1f4f3ef9-7cc2-4e5d-af8a-95b718dbae36 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:40.530337 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1f4f3ef9-7cc2-4e5d-af8a-95b718dbae36 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:40.597976 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-1f4f3ef9-7cc2-4e5d-af8a-95b718dbae36 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "POST /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/action" status: 202 len: 0 microversion: 2.1 time: 0.079357 Dec 23 12:02:40.599135 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 255/545] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:02:40 2021] POST /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:02:40.607502 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-baadc462-7082-4a5e-9510-0289a45643bd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:40.608153 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-baadc462-7082-4a5e-9510-0289a45643bd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:40.615484 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-baadc462-7082-4a5e-9510-0289a45643bd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:40.616052 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-baadc462-7082-4a5e-9510-0289a45643bd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:40.616970 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-baadc462-7082-4a5e-9510-0289a45643bd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:40.617410 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-baadc462-7082-4a5e-9510-0289a45643bd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:40.757288 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-baadc462-7082-4a5e-9510-0289a45643bd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:40.766363 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-baadc462-7082-4a5e-9510-0289a45643bd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1556 microversion: 2.1 time: 0.162576 Dec 23 12:02:40.766990 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 291/546] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:40 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:41.788949 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e5979f63-221b-4de7-8a6a-f68f3c6a7d7a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:41.790486 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e5979f63-221b-4de7-8a6a-f68f3c6a7d7a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:41.803631 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e5979f63-221b-4de7-8a6a-f68f3c6a7d7a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:41.804427 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e5979f63-221b-4de7-8a6a-f68f3c6a7d7a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:41.805873 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e5979f63-221b-4de7-8a6a-f68f3c6a7d7a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:41.806341 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e5979f63-221b-4de7-8a6a-f68f3c6a7d7a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:41.942172 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e5979f63-221b-4de7-8a6a-f68f3c6a7d7a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:41.952479 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e5979f63-221b-4de7-8a6a-f68f3c6a7d7a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1556 microversion: 2.1 time: 0.171351 Dec 23 12:02:41.953060 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 256/547] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:41 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:42.973361 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-01553a8e-c248-4e09-9e92-b2a4fa23939f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:42.974249 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-01553a8e-c248-4e09-9e92-b2a4fa23939f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:42.982286 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-01553a8e-c248-4e09-9e92-b2a4fa23939f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:42.982782 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-01553a8e-c248-4e09-9e92-b2a4fa23939f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:42.983559 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-01553a8e-c248-4e09-9e92-b2a4fa23939f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:42.983994 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-01553a8e-c248-4e09-9e92-b2a4fa23939f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:43.124086 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-01553a8e-c248-4e09-9e92-b2a4fa23939f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:43.135163 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-01553a8e-c248-4e09-9e92-b2a4fa23939f tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1556 microversion: 2.1 time: 0.167649 Dec 23 12:02:43.135910 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 292/548] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:42 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:44.153184 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-865e8120-1e5e-4ebd-8505-0a59c44c14ea tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:44.153757 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-865e8120-1e5e-4ebd-8505-0a59c44c14ea tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:44.160374 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-865e8120-1e5e-4ebd-8505-0a59c44c14ea tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:44.160818 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-865e8120-1e5e-4ebd-8505-0a59c44c14ea tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:44.161648 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-865e8120-1e5e-4ebd-8505-0a59c44c14ea tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:44.162091 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-865e8120-1e5e-4ebd-8505-0a59c44c14ea tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:44.304655 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-865e8120-1e5e-4ebd-8505-0a59c44c14ea tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:44.312953 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-865e8120-1e5e-4ebd-8505-0a59c44c14ea tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1556 microversion: 2.1 time: 0.163675 Dec 23 12:02:44.313557 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 257/549] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:44 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:45.331246 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1e8cf68e-6f10-4a88-a69b-7de8e4535a63 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:45.331875 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1e8cf68e-6f10-4a88-a69b-7de8e4535a63 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:45.338961 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1e8cf68e-6f10-4a88-a69b-7de8e4535a63 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:45.339424 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1e8cf68e-6f10-4a88-a69b-7de8e4535a63 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:45.340217 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1e8cf68e-6f10-4a88-a69b-7de8e4535a63 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:45.340658 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1e8cf68e-6f10-4a88-a69b-7de8e4535a63 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:45.489180 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1e8cf68e-6f10-4a88-a69b-7de8e4535a63 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:45.498665 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1e8cf68e-6f10-4a88-a69b-7de8e4535a63 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1556 microversion: 2.1 time: 0.171052 Dec 23 12:02:45.499323 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 293/550] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:45 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:46.516137 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a8fd9985-e64b-4ea2-a0d8-1715e4bd65bb tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:46.516673 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a8fd9985-e64b-4ea2-a0d8-1715e4bd65bb tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:46.525659 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a8fd9985-e64b-4ea2-a0d8-1715e4bd65bb tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:46.526488 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a8fd9985-e64b-4ea2-a0d8-1715e4bd65bb tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:46.527464 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a8fd9985-e64b-4ea2-a0d8-1715e4bd65bb tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:46.528070 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a8fd9985-e64b-4ea2-a0d8-1715e4bd65bb tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:46.669648 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a8fd9985-e64b-4ea2-a0d8-1715e4bd65bb tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:46.677811 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a8fd9985-e64b-4ea2-a0d8-1715e4bd65bb tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1556 microversion: 2.1 time: 0.165509 Dec 23 12:02:46.678395 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 258/551] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:46 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:47.695253 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e524f6e4-58e4-4fc1-ac68-9e804deecffd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:47.695938 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e524f6e4-58e4-4fc1-ac68-9e804deecffd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:47.702858 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e524f6e4-58e4-4fc1-ac68-9e804deecffd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:47.703309 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e524f6e4-58e4-4fc1-ac68-9e804deecffd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:47.704077 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e524f6e4-58e4-4fc1-ac68-9e804deecffd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:47.704500 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e524f6e4-58e4-4fc1-ac68-9e804deecffd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:47.844247 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e524f6e4-58e4-4fc1-ac68-9e804deecffd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:47.856183 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e524f6e4-58e4-4fc1-ac68-9e804deecffd tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1556 microversion: 2.1 time: 0.164636 Dec 23 12:02:47.856743 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 294/552] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:47 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:48.877429 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-beefd331-b091-455b-8ec5-4b3af67555b1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:48.878430 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-beefd331-b091-455b-8ec5-4b3af67555b1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:48.887863 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-beefd331-b091-455b-8ec5-4b3af67555b1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:48.888321 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-beefd331-b091-455b-8ec5-4b3af67555b1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:48.889107 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-beefd331-b091-455b-8ec5-4b3af67555b1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:48.889547 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-beefd331-b091-455b-8ec5-4b3af67555b1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:49.021019 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-beefd331-b091-455b-8ec5-4b3af67555b1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:49.030000 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-beefd331-b091-455b-8ec5-4b3af67555b1 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1556 microversion: 2.1 time: 0.158640 Dec 23 12:02:49.030605 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 259/553] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:48 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:50.047935 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5ca5c4dd-8a20-43b8-98e6-5764ac2c3d68 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:50.048533 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5ca5c4dd-8a20-43b8-98e6-5764ac2c3d68 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:50.054940 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5ca5c4dd-8a20-43b8-98e6-5764ac2c3d68 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:50.055386 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5ca5c4dd-8a20-43b8-98e6-5764ac2c3d68 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:50.056155 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5ca5c4dd-8a20-43b8-98e6-5764ac2c3d68 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:50.056587 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5ca5c4dd-8a20-43b8-98e6-5764ac2c3d68 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:50.202327 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-5ca5c4dd-8a20-43b8-98e6-5764ac2c3d68 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:50.216076 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5ca5c4dd-8a20-43b8-98e6-5764ac2c3d68 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1556 microversion: 2.1 time: 0.172254 Dec 23 12:02:50.216835 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 295/554] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:50 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:51.237743 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-71ee0273-81fc-4c1f-ad34-8d9cd7aa7447 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:51.238357 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-71ee0273-81fc-4c1f-ad34-8d9cd7aa7447 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:51.244973 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-71ee0273-81fc-4c1f-ad34-8d9cd7aa7447 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:51.245426 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-71ee0273-81fc-4c1f-ad34-8d9cd7aa7447 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:51.246386 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-71ee0273-81fc-4c1f-ad34-8d9cd7aa7447 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:51.246852 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-71ee0273-81fc-4c1f-ad34-8d9cd7aa7447 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:51.402481 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-71ee0273-81fc-4c1f-ad34-8d9cd7aa7447 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:51.410910 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-71ee0273-81fc-4c1f-ad34-8d9cd7aa7447 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1556 microversion: 2.1 time: 0.177118 Dec 23 12:02:51.411757 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 260/555] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:51 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:52.431141 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f6f95420-2f98-419f-b243-c0736bd2f677 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:52.431713 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f6f95420-2f98-419f-b243-c0736bd2f677 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:52.439715 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f6f95420-2f98-419f-b243-c0736bd2f677 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:52.440257 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f6f95420-2f98-419f-b243-c0736bd2f677 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:52.441135 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f6f95420-2f98-419f-b243-c0736bd2f677 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:52.441653 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f6f95420-2f98-419f-b243-c0736bd2f677 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:52.579789 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f6f95420-2f98-419f-b243-c0736bd2f677 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:52.592762 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f6f95420-2f98-419f-b243-c0736bd2f677 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1562 microversion: 2.1 time: 0.166020 Dec 23 12:02:52.593648 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 296/556] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:52 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:52.667190 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b9b1b363-aef6-4140-a36f-3110a3cd8b4b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:52.668064 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b9b1b363-aef6-4140-a36f-3110a3cd8b4b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:52.677408 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b9b1b363-aef6-4140-a36f-3110a3cd8b4b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:52.677866 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b9b1b363-aef6-4140-a36f-3110a3cd8b4b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:52.678683 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b9b1b363-aef6-4140-a36f-3110a3cd8b4b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:52.679124 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b9b1b363-aef6-4140-a36f-3110a3cd8b4b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:52.807981 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.objects.instance [None req-b9b1b363-aef6-4140-a36f-3110a3cd8b4b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lazy-loading 'services' on Instance uuid 15f88906-0a5f-47a4-bf35-55db395a0e97 {{(pid=116355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:02:52.936692 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b9b1b363-aef6-4140-a36f-3110a3cd8b4b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "DELETE /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/os-volume_attachments/f5a4d92b-0574-49e0-b118-6628ec8c9267" status: 202 len: 0 microversion: 2.1 time: 0.272803 Dec 23 12:02:52.937290 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 261/557] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Dec 23 12:02:52 2021] DELETE /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/os-volume_attachments/f5a4d92b-0574-49e0-b118-6628ec8c9267 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:02:52.945659 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e2edbe89-7f5a-48f1-aee7-b03b6b031ef9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:52.946701 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e2edbe89-7f5a-48f1-aee7-b03b6b031ef9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:52.952964 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2edbe89-7f5a-48f1-aee7-b03b6b031ef9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:52.953410 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2edbe89-7f5a-48f1-aee7-b03b6b031ef9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:52.954183 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2edbe89-7f5a-48f1-aee7-b03b6b031ef9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:52.954647 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2edbe89-7f5a-48f1-aee7-b03b6b031ef9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:52.985072 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e2edbe89-7f5a-48f1-aee7-b03b6b031ef9 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042806 Dec 23 12:02:52.985645 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 297/558] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:02:52 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:02:53.579784 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b45a5c44-ee01-466b-8b7e-6320d68ca507 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:53.580373 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b45a5c44-ee01-466b-8b7e-6320d68ca507 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:53.586995 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b45a5c44-ee01-466b-8b7e-6320d68ca507 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:53.587459 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b45a5c44-ee01-466b-8b7e-6320d68ca507 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:53.588240 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b45a5c44-ee01-466b-8b7e-6320d68ca507 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:53.588682 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b45a5c44-ee01-466b-8b7e-6320d68ca507 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:53.673520 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.objects.instance [None req-b45a5c44-ee01-466b-8b7e-6320d68ca507 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lazy-loading 'services' on Instance uuid 68e5b661-c9f6-4d62-8a57-8aec6a201f21 {{(pid=116355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:02:53.748998 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b45a5c44-ee01-466b-8b7e-6320d68ca507 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "DELETE /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21/os-volume_attachments/20966fae-ca88-46a0-acb3-05b15d461f17" status: 202 len: 0 microversion: 2.1 time: 0.173136 Dec 23 12:02:53.749559 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 262/559] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Dec 23 12:02:53 2021] DELETE /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21/os-volume_attachments/20966fae-ca88-46a0-acb3-05b15d461f17 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:02:53.995989 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a891ee7f-36a3-422e-a65e-6e0227e23af2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:53.996919 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a891ee7f-36a3-422e-a65e-6e0227e23af2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:54.003071 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a891ee7f-36a3-422e-a65e-6e0227e23af2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:54.003525 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a891ee7f-36a3-422e-a65e-6e0227e23af2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:54.004315 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a891ee7f-36a3-422e-a65e-6e0227e23af2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:54.004757 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a891ee7f-36a3-422e-a65e-6e0227e23af2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:54.035478 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a891ee7f-36a3-422e-a65e-6e0227e23af2 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043523 Dec 23 12:02:54.036055 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 298/560] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:02:53 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:02:55.048656 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-60a79582-2ff7-4205-b0ac-79f5ea56ce30 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:55.049714 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-60a79582-2ff7-4205-b0ac-79f5ea56ce30 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:55.056288 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-60a79582-2ff7-4205-b0ac-79f5ea56ce30 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:55.057011 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-60a79582-2ff7-4205-b0ac-79f5ea56ce30 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:55.058373 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-60a79582-2ff7-4205-b0ac-79f5ea56ce30 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:55.059193 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-60a79582-2ff7-4205-b0ac-79f5ea56ce30 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:55.090885 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-60a79582-2ff7-4205-b0ac-79f5ea56ce30 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046885 Dec 23 12:02:55.091626 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 263/561] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:02:55 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:02:55.922709 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4e4f117b-ed77-4060-8728-5529959eb406 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:55.923261 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4e4f117b-ed77-4060-8728-5529959eb406 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:55.929888 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4e4f117b-ed77-4060-8728-5529959eb406 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:55.930354 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4e4f117b-ed77-4060-8728-5529959eb406 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:55.931174 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4e4f117b-ed77-4060-8728-5529959eb406 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:55.931618 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4e4f117b-ed77-4060-8728-5529959eb406 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:55.961728 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4e4f117b-ed77-4060-8728-5529959eb406 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Going to try to terminate instance {{(pid=116354) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:02:56.045616 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4e4f117b-ed77-4060-8728-5529959eb406 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "DELETE /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 204 len: 0 microversion: 2.1 time: 0.126626 Dec 23 12:02:56.046378 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 299/562] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:02:55 2021] DELETE /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:02:56.054714 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-fb358a30-c30e-4a39-acb5-a6f54712eb0c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:56.055335 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-fb358a30-c30e-4a39-acb5-a6f54712eb0c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:56.061781 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fb358a30-c30e-4a39-acb5-a6f54712eb0c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:56.062280 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fb358a30-c30e-4a39-acb5-a6f54712eb0c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:56.063111 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fb358a30-c30e-4a39-acb5-a6f54712eb0c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:56.063554 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fb358a30-c30e-4a39-acb5-a6f54712eb0c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:56.197380 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-fb358a30-c30e-4a39-acb5-a6f54712eb0c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:56.205099 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-fb358a30-c30e-4a39-acb5-a6f54712eb0c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1514 microversion: 2.1 time: 0.154563 Dec 23 12:02:56.205680 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 264/563] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:56 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:57.224631 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2ae4aaf3-2048-4373-a057-e7db5a9f4b70 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:57.225240 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2ae4aaf3-2048-4373-a057-e7db5a9f4b70 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:57.232091 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2ae4aaf3-2048-4373-a057-e7db5a9f4b70 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:57.232548 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2ae4aaf3-2048-4373-a057-e7db5a9f4b70 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:57.233338 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2ae4aaf3-2048-4373-a057-e7db5a9f4b70 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:57.233782 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2ae4aaf3-2048-4373-a057-e7db5a9f4b70 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:57.373370 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2ae4aaf3-2048-4373-a057-e7db5a9f4b70 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:57.381947 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2ae4aaf3-2048-4373-a057-e7db5a9f4b70 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1514 microversion: 2.1 time: 0.162933 Dec 23 12:02:57.382522 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 300/564] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:57 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:57.441713 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-fa038afa-7088-49c8-81d8-065d25e7fc60 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:57.442196 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-fa038afa-7088-49c8-81d8-065d25e7fc60 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:57.448882 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fa038afa-7088-49c8-81d8-065d25e7fc60 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:57.449348 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fa038afa-7088-49c8-81d8-065d25e7fc60 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:57.450133 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fa038afa-7088-49c8-81d8-065d25e7fc60 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:57.450603 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fa038afa-7088-49c8-81d8-065d25e7fc60 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:57.475138 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-fa038afa-7088-49c8-81d8-065d25e7fc60 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Going to try to terminate instance {{(pid=116355) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:02:57.566314 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-fa038afa-7088-49c8-81d8-065d25e7fc60 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 204 len: 0 microversion: 2.1 time: 0.127649 Dec 23 12:02:57.567440 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 265/565] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:02:57 2021] DELETE /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:02:57.576135 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c5670b0b-741a-430c-b815-41f27de73577 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:57.577551 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c5670b0b-741a-430c-b815-41f27de73577 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:57.584202 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c5670b0b-741a-430c-b815-41f27de73577 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:57.584696 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c5670b0b-741a-430c-b815-41f27de73577 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:57.585491 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c5670b0b-741a-430c-b815-41f27de73577 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:57.585931 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c5670b0b-741a-430c-b815-41f27de73577 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:57.740313 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c5670b0b-741a-430c-b815-41f27de73577 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:57.748499 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c5670b0b-741a-430c-b815-41f27de73577 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1508 microversion: 2.1 time: 0.176441 Dec 23 12:02:57.749134 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 301/566] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:57 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:58.401228 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-38a2e19f-ebf1-4f15-bfc4-1e011b80dfb1 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:58.402428 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-38a2e19f-ebf1-4f15-bfc4-1e011b80dfb1 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:58.411911 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-38a2e19f-ebf1-4f15-bfc4-1e011b80dfb1 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:58.412701 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-38a2e19f-ebf1-4f15-bfc4-1e011b80dfb1 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:58.413819 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-38a2e19f-ebf1-4f15-bfc4-1e011b80dfb1 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:58.414324 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-38a2e19f-ebf1-4f15-bfc4-1e011b80dfb1 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:58.553878 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-38a2e19f-ebf1-4f15-bfc4-1e011b80dfb1 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:58.564533 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-38a2e19f-ebf1-4f15-bfc4-1e011b80dfb1 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1514 microversion: 2.1 time: 0.168939 Dec 23 12:02:58.565138 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 266/567] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:58 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:58.775038 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f5c4d458-21a9-4f8d-931e-f52d9b438808 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:58.776100 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f5c4d458-21a9-4f8d-931e-f52d9b438808 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:58.785617 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f5c4d458-21a9-4f8d-931e-f52d9b438808 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:58.786073 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f5c4d458-21a9-4f8d-931e-f52d9b438808 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:58.786885 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f5c4d458-21a9-4f8d-931e-f52d9b438808 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:58.787347 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f5c4d458-21a9-4f8d-931e-f52d9b438808 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:58.927767 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f5c4d458-21a9-4f8d-931e-f52d9b438808 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:58.935764 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f5c4d458-21a9-4f8d-931e-f52d9b438808 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1508 microversion: 2.1 time: 0.166777 Dec 23 12:02:58.936305 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 302/568] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:58 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:59.589441 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-337ba5e8-8036-4cb7-9ef7-3db7149955ea tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:59.590058 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-337ba5e8-8036-4cb7-9ef7-3db7149955ea tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:59.597153 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-337ba5e8-8036-4cb7-9ef7-3db7149955ea tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:59.597644 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-337ba5e8-8036-4cb7-9ef7-3db7149955ea tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:59.598422 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-337ba5e8-8036-4cb7-9ef7-3db7149955ea tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:59.598912 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-337ba5e8-8036-4cb7-9ef7-3db7149955ea tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:59.812642 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-337ba5e8-8036-4cb7-9ef7-3db7149955ea tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:02:59.820208 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-337ba5e8-8036-4cb7-9ef7-3db7149955ea tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 200 len: 1514 microversion: 2.1 time: 0.236310 Dec 23 12:02:59.820774 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 267/569] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:59 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 1514 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:02:59.907449 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-bce07623-1799-490c-80d2-f602b17d5f6d req-ed34c877-5378-4a4f-8a8f-a7c5b708370d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e5b661-c9f6-4d62-8a57-8aec6a201f21", "name": "network-vif-deleted", "tag": "11258d40-4dbb-42a5-ad95-431f3b8b1f82"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:02:59.909180 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:02:59.909180 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:02:59.916935 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-bce07623-1799-490c-80d2-f602b17d5f6d req-ed34c877-5378-4a4f-8a8f-a7c5b708370d service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:59.917428 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-bce07623-1799-490c-80d2-f602b17d5f6d req-ed34c877-5378-4a4f-8a8f-a7c5b708370d service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:59.928265 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-bce07623-1799-490c-80d2-f602b17d5f6d req-ed34c877-5378-4a4f-8a8f-a7c5b708370d service nova] Creating event network-vif-deleted:11258d40-4dbb-42a5-ad95-431f3b8b1f82 for instance 68e5b661-c9f6-4d62-8a57-8aec6a201f21 on hv-cinder-82282 Dec 23 12:02:59.933747 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-bce07623-1799-490c-80d2-f602b17d5f6d req-ed34c877-5378-4a4f-8a8f-a7c5b708370d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029729 Dec 23 12:02:59.934461 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 303/570] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:02:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:02:59.957284 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-cb4bc113-1fe3-40f9-807e-10fe97e87e80 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:02:59.957909 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-cb4bc113-1fe3-40f9-807e-10fe97e87e80 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:02:59.964708 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cb4bc113-1fe3-40f9-807e-10fe97e87e80 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:59.965162 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cb4bc113-1fe3-40f9-807e-10fe97e87e80 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:02:59.965949 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cb4bc113-1fe3-40f9-807e-10fe97e87e80 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:02:59.966389 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cb4bc113-1fe3-40f9-807e-10fe97e87e80 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:00.101402 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-cb4bc113-1fe3-40f9-807e-10fe97e87e80 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:00.108841 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-cb4bc113-1fe3-40f9-807e-10fe97e87e80 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1508 microversion: 2.1 time: 0.155440 Dec 23 12:03:00.109410 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 268/571] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:02:59 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:00.838017 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-007997aa-6692-4e22-9e1e-09164f807208 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:00.838749 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-007997aa-6692-4e22-9e1e-09164f807208 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 68e5b661-c9f6-4d62-8a57-8aec6a201f21] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:00.844893 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-007997aa-6692-4e22-9e1e-09164f807208 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:00.845351 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-007997aa-6692-4e22-9e1e-09164f807208 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:00.846135 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-007997aa-6692-4e22-9e1e-09164f807208 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:00.846606 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-007997aa-6692-4e22-9e1e-09164f807208 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:00.859385 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-007997aa-6692-4e22-9e1e-09164f807208 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] HTTP exception thrown: Instance 68e5b661-c9f6-4d62-8a57-8aec6a201f21 could not be found. Dec 23 12:03:00.860328 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-007997aa-6692-4e22-9e1e-09164f807208 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Returning 404 to user: Instance 68e5b661-c9f6-4d62-8a57-8aec6a201f21 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:03:00.861165 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-007997aa-6692-4e22-9e1e-09164f807208 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21" status: 404 len: 111 microversion: 2.1 time: 0.027360 Dec 23 12:03:00.861664 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 304/572] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:00 2021] GET /compute/v2.1/servers/68e5b661-c9f6-4d62-8a57-8aec6a201f21 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:03:01.130279 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-927e4555-06cf-4470-9e69-0e94543770cc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:01.131346 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-927e4555-06cf-4470-9e69-0e94543770cc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:01.141746 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-927e4555-06cf-4470-9e69-0e94543770cc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:01.142394 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-927e4555-06cf-4470-9e69-0e94543770cc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:01.143492 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-927e4555-06cf-4470-9e69-0e94543770cc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:01.144104 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-927e4555-06cf-4470-9e69-0e94543770cc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:01.298031 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-927e4555-06cf-4470-9e69-0e94543770cc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:01.306004 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-927e4555-06cf-4470-9e69-0e94543770cc tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1508 microversion: 2.1 time: 0.181754 Dec 23 12:03:01.306600 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 269/573] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:01 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:02.331655 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-6b5e3e49-1aee-4e82-96e0-185434b3231a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:02.332546 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-6b5e3e49-1aee-4e82-96e0-185434b3231a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:02.343589 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6b5e3e49-1aee-4e82-96e0-185434b3231a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:02.344398 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6b5e3e49-1aee-4e82-96e0-185434b3231a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:02.345685 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6b5e3e49-1aee-4e82-96e0-185434b3231a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:02.346401 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6b5e3e49-1aee-4e82-96e0-185434b3231a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:02.483588 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-6b5e3e49-1aee-4e82-96e0-185434b3231a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:02.492589 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-6b5e3e49-1aee-4e82-96e0-185434b3231a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1508 microversion: 2.1 time: 0.167233 Dec 23 12:03:02.493152 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 305/574] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:02 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:03.513394 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f2db8aa9-1c1a-4ce2-9b31-c78f6d8ad554 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:03.514406 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f2db8aa9-1c1a-4ce2-9b31-c78f6d8ad554 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:03.523265 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f2db8aa9-1c1a-4ce2-9b31-c78f6d8ad554 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:03.523719 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f2db8aa9-1c1a-4ce2-9b31-c78f6d8ad554 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:03.524497 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f2db8aa9-1c1a-4ce2-9b31-c78f6d8ad554 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:03.524933 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f2db8aa9-1c1a-4ce2-9b31-c78f6d8ad554 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:03.680576 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-f2db8aa9-1c1a-4ce2-9b31-c78f6d8ad554 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:03.688585 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f2db8aa9-1c1a-4ce2-9b31-c78f6d8ad554 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1508 microversion: 2.1 time: 0.181376 Dec 23 12:03:03.689155 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 270/575] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:03 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:04.706462 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7924caea-a98c-48fb-bd56-97a60d4cacc7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:04.707109 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-7924caea-a98c-48fb-bd56-97a60d4cacc7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:04.714264 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7924caea-a98c-48fb-bd56-97a60d4cacc7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:04.714763 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7924caea-a98c-48fb-bd56-97a60d4cacc7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:04.715548 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7924caea-a98c-48fb-bd56-97a60d4cacc7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:04.715989 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7924caea-a98c-48fb-bd56-97a60d4cacc7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:04.853447 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-7924caea-a98c-48fb-bd56-97a60d4cacc7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:04.861983 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-7924caea-a98c-48fb-bd56-97a60d4cacc7 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1508 microversion: 2.1 time: 0.159362 Dec 23 12:03:04.862698 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 306/576] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:04 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:05.878851 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c9de571d-2401-4dc3-8c8c-cd1dc69ece86 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:05.879522 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c9de571d-2401-4dc3-8c8c-cd1dc69ece86 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:05.885994 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c9de571d-2401-4dc3-8c8c-cd1dc69ece86 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:05.886466 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c9de571d-2401-4dc3-8c8c-cd1dc69ece86 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:05.887361 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c9de571d-2401-4dc3-8c8c-cd1dc69ece86 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:05.887795 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c9de571d-2401-4dc3-8c8c-cd1dc69ece86 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:06.094114 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-5ba958fc-4573-4d54-acc1-3a2b47f46e1e req-e6e8ee6e-ae0b-4563-a32f-3c8047566b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c78f6c-0393-44fa-8edd-0fe5cc257d7f", "name": "network-vif-deleted", "tag": "4c211a14-71cd-421b-8af4-29651931f338"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:06.098549 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:03:06.098549 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:03:06.111067 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-5ba958fc-4573-4d54-acc1-3a2b47f46e1e req-e6e8ee6e-ae0b-4563-a32f-3c8047566b92 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:06.111956 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-5ba958fc-4573-4d54-acc1-3a2b47f46e1e req-e6e8ee6e-ae0b-4563-a32f-3c8047566b92 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:06.124571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-5ba958fc-4573-4d54-acc1-3a2b47f46e1e req-e6e8ee6e-ae0b-4563-a32f-3c8047566b92 service nova] Creating event network-vif-deleted:4c211a14-71cd-421b-8af4-29651931f338 for instance f1c78f6c-0393-44fa-8edd-0fe5cc257d7f on hv-cinder-82282 Dec 23 12:03:06.132204 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c9de571d-2401-4dc3-8c8c-cd1dc69ece86 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:06.139191 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-5ba958fc-4573-4d54-acc1-3a2b47f46e1e req-e6e8ee6e-ae0b-4563-a32f-3c8047566b92 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039315 Dec 23 12:03:06.139847 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 307/577] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:03:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:03:06.141518 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c9de571d-2401-4dc3-8c8c-cd1dc69ece86 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 200 len: 1508 microversion: 2.1 time: 0.265643 Dec 23 12:03:06.151794 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 271/578] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:05 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 1508 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:07.164437 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-bc88ee48-6ca6-4f6f-b508-6a29eec32994 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:07.165531 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-bc88ee48-6ca6-4f6f-b508-6a29eec32994 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: f1c78f6c-0393-44fa-8edd-0fe5cc257d7f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:07.175208 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-bc88ee48-6ca6-4f6f-b508-6a29eec32994 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:07.175948 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-bc88ee48-6ca6-4f6f-b508-6a29eec32994 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:07.177200 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-bc88ee48-6ca6-4f6f-b508-6a29eec32994 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:07.177922 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-bc88ee48-6ca6-4f6f-b508-6a29eec32994 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:07.191335 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-bc88ee48-6ca6-4f6f-b508-6a29eec32994 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] HTTP exception thrown: Instance f1c78f6c-0393-44fa-8edd-0fe5cc257d7f could not be found. Dec 23 12:03:07.191908 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-bc88ee48-6ca6-4f6f-b508-6a29eec32994 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Returning 404 to user: Instance f1c78f6c-0393-44fa-8edd-0fe5cc257d7f could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:03:07.192728 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-bc88ee48-6ca6-4f6f-b508-6a29eec32994 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f" status: 404 len: 111 microversion: 2.1 time: 0.035607 Dec 23 12:03:07.193246 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 308/579] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:07 2021] GET /compute/v2.1/servers/f1c78f6c-0393-44fa-8edd-0fe5cc257d7f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:03:07.201343 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c1674e12-1a88-460a-a9ab-ec3ba9777be3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:07.201882 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c1674e12-1a88-460a-a9ab-ec3ba9777be3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:07.208509 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c1674e12-1a88-460a-a9ab-ec3ba9777be3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:07.208958 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c1674e12-1a88-460a-a9ab-ec3ba9777be3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:07.209726 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c1674e12-1a88-460a-a9ab-ec3ba9777be3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:07.210212 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c1674e12-1a88-460a-a9ab-ec3ba9777be3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:07.235045 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c1674e12-1a88-460a-a9ab-ec3ba9777be3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Going to try to terminate instance {{(pid=116355) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:03:07.311234 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c1674e12-1a88-460a-a9ab-ec3ba9777be3 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "DELETE /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 204 len: 0 microversion: 2.1 time: 0.113008 Dec 23 12:03:07.312049 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 272/580] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:03:07 2021] DELETE /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:03:07.321597 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-faa1171f-911e-4425-9a6e-342e02fbe81b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:07.322201 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-faa1171f-911e-4425-9a6e-342e02fbe81b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:07.328291 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-faa1171f-911e-4425-9a6e-342e02fbe81b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:07.328736 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-faa1171f-911e-4425-9a6e-342e02fbe81b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:07.329500 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-faa1171f-911e-4425-9a6e-342e02fbe81b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:07.329934 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-faa1171f-911e-4425-9a6e-342e02fbe81b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:07.465362 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-faa1171f-911e-4425-9a6e-342e02fbe81b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:07.473105 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-faa1171f-911e-4425-9a6e-342e02fbe81b tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.155194 Dec 23 12:03:07.473672 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 309/581] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:07 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:08.493191 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b890206e-01ec-419c-b33c-cef0f6b384f6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:08.494270 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b890206e-01ec-419c-b33c-cef0f6b384f6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:08.501922 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b890206e-01ec-419c-b33c-cef0f6b384f6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:08.502465 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b890206e-01ec-419c-b33c-cef0f6b384f6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:08.503426 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b890206e-01ec-419c-b33c-cef0f6b384f6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:08.503945 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b890206e-01ec-419c-b33c-cef0f6b384f6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:08.651895 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b890206e-01ec-419c-b33c-cef0f6b384f6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:08.660050 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b890206e-01ec-419c-b33c-cef0f6b384f6 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.172187 Dec 23 12:03:08.660614 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 273/582] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:08 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:09.681335 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-cd66ab9f-41da-4d56-bff7-8d43a99da119 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:09.682305 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-cd66ab9f-41da-4d56-bff7-8d43a99da119 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:09.691931 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd66ab9f-41da-4d56-bff7-8d43a99da119 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:09.692568 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd66ab9f-41da-4d56-bff7-8d43a99da119 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:09.693801 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd66ab9f-41da-4d56-bff7-8d43a99da119 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:09.694462 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd66ab9f-41da-4d56-bff7-8d43a99da119 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:09.848714 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-cd66ab9f-41da-4d56-bff7-8d43a99da119 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:09.857324 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-cd66ab9f-41da-4d56-bff7-8d43a99da119 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.182590 Dec 23 12:03:09.857895 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 310/583] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:09 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:10.795745 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2a0451f5-0fb5-4d33-a566-7a4972dff7c2 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-671912647", "imageRef": "938a78c0-341e-4043-927a-9bfe8cf52508", "flavorRef": "452", "networks": [{"uuid": "e6a08c68-4efd-455d-9eb5-a5d51e2dc856"}]}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:10.847785 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.network.neutron [None req-2a0451f5-0fb5-4d33-a566-7a4972dff7c2 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] validate_networks() for [('e6a08c68-4efd-455d-9eb5-a5d51e2dc856', None, None, None, None, None)] {{(pid=116355) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 12:03:10.874964 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2d21e03f-5527-44fa-9547-31a1af5bc5f0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:10.875582 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2d21e03f-5527-44fa-9547-31a1af5bc5f0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:10.882634 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2d21e03f-5527-44fa-9547-31a1af5bc5f0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:10.883079 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2d21e03f-5527-44fa-9547-31a1af5bc5f0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:10.883875 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2d21e03f-5527-44fa-9547-31a1af5bc5f0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:10.884317 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2d21e03f-5527-44fa-9547-31a1af5bc5f0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:11.077933 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2d21e03f-5527-44fa-9547-31a1af5bc5f0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:11.085848 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2d21e03f-5527-44fa-9547-31a1af5bc5f0 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.214582 Dec 23 12:03:11.086419 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 311/584] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:10 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:11.241179 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-2a0451f5-0fb5-4d33-a566-7a4972dff7c2 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Flavor limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 12:03:11.241828 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-2a0451f5-0fb5-4d33-a566-7a4972dff7c2 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Image limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 12:03:11.242326 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-2a0451f5-0fb5-4d33-a566-7a4972dff7c2 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Flavor pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 12:03:11.242762 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-2a0451f5-0fb5-4d33-a566-7a4972dff7c2 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Image pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 12:03:11.243175 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-2a0451f5-0fb5-4d33-a566-7a4972dff7c2 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 12:03:11.254770 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2a0451f5-0fb5-4d33-a566-7a4972dff7c2 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:11.255303 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2a0451f5-0fb5-4d33-a566-7a4972dff7c2 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:11.256422 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2a0451f5-0fb5-4d33-a566-7a4972dff7c2 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:11.257134 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2a0451f5-0fb5-4d33-a566-7a4972dff7c2 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:11.280080 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-2a0451f5-0fb5-4d33-a566-7a4972dff7c2 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Getting quotas for project 656fb5fa69a64dd49ed36532dfa2ef18. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:03:11.284528 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-2a0451f5-0fb5-4d33-a566-7a4972dff7c2 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Getting quotas for user 26fed87e1ecb47478db1cffa6d53f416 and project 656fb5fa69a64dd49ed36532dfa2ef18. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:03:11.295830 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2a0451f5-0fb5-4d33-a566-7a4972dff7c2 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Going to run 1 instances... {{(pid=116355) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 12:03:11.298109 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2a0451f5-0fb5-4d33-a566-7a4972dff7c2 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='938a78c0-341e-4043-927a-9bfe8cf52508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 12:03:11.352702 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2a0451f5-0fb5-4d33-a566-7a4972dff7c2 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560558 Dec 23 12:03:11.353355 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 274/585] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 12:03:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 12:03:11.363539 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1032e5bd-3fbd-4e17-a343-fcd8a0234053 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:11.364242 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1032e5bd-3fbd-4e17-a343-fcd8a0234053 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:11.414942 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1032e5bd-3fbd-4e17-a343-fcd8a0234053 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:11.421437 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1032e5bd-3fbd-4e17-a343-fcd8a0234053 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 200 len: 1218 microversion: 2.1 time: 0.062010 Dec 23 12:03:11.422002 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 312/586] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:11 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 1218 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:12.106696 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ddb838fd-ca2e-48e7-b096-4cef4565c496 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:12.107600 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ddb838fd-ca2e-48e7-b096-4cef4565c496 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:12.117770 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ddb838fd-ca2e-48e7-b096-4cef4565c496 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:12.118160 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ddb838fd-ca2e-48e7-b096-4cef4565c496 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:12.118964 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ddb838fd-ca2e-48e7-b096-4cef4565c496 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:12.119397 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ddb838fd-ca2e-48e7-b096-4cef4565c496 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:12.249114 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ddb838fd-ca2e-48e7-b096-4cef4565c496 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:12.257382 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ddb838fd-ca2e-48e7-b096-4cef4565c496 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.157272 Dec 23 12:03:12.257946 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 275/587] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:12 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:12.438874 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5e8a30ba-a91a-499f-a8a3-4c2c4c2a3d66 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:12.439420 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5e8a30ba-a91a-499f-a8a3-4c2c4c2a3d66 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:12.446210 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5e8a30ba-a91a-499f-a8a3-4c2c4c2a3d66 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:12.446697 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5e8a30ba-a91a-499f-a8a3-4c2c4c2a3d66 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:12.447491 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5e8a30ba-a91a-499f-a8a3-4c2c4c2a3d66 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:12.447933 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5e8a30ba-a91a-499f-a8a3-4c2c4c2a3d66 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:12.510264 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-5e8a30ba-a91a-499f-a8a3-4c2c4c2a3d66 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:12.518454 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5e8a30ba-a91a-499f-a8a3-4c2c4c2a3d66 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 200 len: 1270 microversion: 2.1 time: 0.083377 Dec 23 12:03:12.519055 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 313/588] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:12 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:13.282341 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-9280d9ff-4146-4903-b94b-3e1d9df87066 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:13.283140 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-9280d9ff-4146-4903-b94b-3e1d9df87066 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:13.291581 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9280d9ff-4146-4903-b94b-3e1d9df87066 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:13.292038 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9280d9ff-4146-4903-b94b-3e1d9df87066 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:13.292998 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9280d9ff-4146-4903-b94b-3e1d9df87066 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:13.293448 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9280d9ff-4146-4903-b94b-3e1d9df87066 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:13.507031 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-9280d9ff-4146-4903-b94b-3e1d9df87066 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:13.514890 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-9280d9ff-4146-4903-b94b-3e1d9df87066 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.238076 Dec 23 12:03:13.515709 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 276/589] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:13 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:13.535597 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-247dcd9e-6e78-4066-b761-84f09c8768c7 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:13.536267 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-247dcd9e-6e78-4066-b761-84f09c8768c7 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:13.542771 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-247dcd9e-6e78-4066-b761-84f09c8768c7 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:13.543229 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-247dcd9e-6e78-4066-b761-84f09c8768c7 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:13.544027 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-247dcd9e-6e78-4066-b761-84f09c8768c7 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:13.544473 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-247dcd9e-6e78-4066-b761-84f09c8768c7 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:13.773286 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-247dcd9e-6e78-4066-b761-84f09c8768c7 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:13.781205 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-247dcd9e-6e78-4066-b761-84f09c8768c7 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 200 len: 1318 microversion: 2.1 time: 0.249264 Dec 23 12:03:13.781799 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 314/590] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:13 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:14.331304 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-cf7cc535-3ad6-4be7-8c4b-71cbe0d0e3d1 req-ed91a7b1-7cfc-40bb-a6d6-603b3083bccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e4ca63a-c7c0-4b76-877d-bd3963a3d552", "tag": "a7278194-1bcb-422c-b9af-18f3d0d578cc"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:14.332850 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:03:14.332850 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:03:14.340527 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-cf7cc535-3ad6-4be7-8c4b-71cbe0d0e3d1 req-ed91a7b1-7cfc-40bb-a6d6-603b3083bccc service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:14.340969 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-cf7cc535-3ad6-4be7-8c4b-71cbe0d0e3d1 req-ed91a7b1-7cfc-40bb-a6d6-603b3083bccc service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:14.352481 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-cf7cc535-3ad6-4be7-8c4b-71cbe0d0e3d1 req-ed91a7b1-7cfc-40bb-a6d6-603b3083bccc service nova] Creating event network-changed:a7278194-1bcb-422c-b9af-18f3d0d578cc for instance 4e4ca63a-c7c0-4b76-877d-bd3963a3d552 on hv-cinder-82282 Dec 23 12:03:14.361303 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-cf7cc535-3ad6-4be7-8c4b-71cbe0d0e3d1 req-ed91a7b1-7cfc-40bb-a6d6-603b3083bccc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033534 Dec 23 12:03:14.361897 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 277/591] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:03:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:03:14.535451 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-08b47dc8-b266-4649-a415-c178b750c27a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:14.536072 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-08b47dc8-b266-4649-a415-c178b750c27a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:14.542888 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-08b47dc8-b266-4649-a415-c178b750c27a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:14.543343 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-08b47dc8-b266-4649-a415-c178b750c27a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:14.544142 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-08b47dc8-b266-4649-a415-c178b750c27a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:14.544575 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-08b47dc8-b266-4649-a415-c178b750c27a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:14.758578 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-08b47dc8-b266-4649-a415-c178b750c27a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:14.766450 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-08b47dc8-b266-4649-a415-c178b750c27a tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.236614 Dec 23 12:03:14.767305 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 315/592] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:14 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:14.798328 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ad30c968-f0b3-4b99-850a-a13552a5ccc0 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:14.799071 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ad30c968-f0b3-4b99-850a-a13552a5ccc0 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:14.805480 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ad30c968-f0b3-4b99-850a-a13552a5ccc0 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:14.805955 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ad30c968-f0b3-4b99-850a-a13552a5ccc0 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:14.806807 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ad30c968-f0b3-4b99-850a-a13552a5ccc0 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:14.807227 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ad30c968-f0b3-4b99-850a-a13552a5ccc0 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:14.975946 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ad30c968-f0b3-4b99-850a-a13552a5ccc0 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:14.983763 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ad30c968-f0b3-4b99-850a-a13552a5ccc0 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 200 len: 1318 microversion: 2.1 time: 0.189432 Dec 23 12:03:14.984338 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 278/593] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:14 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:15.786272 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-058e201c-a378-4d22-bf79-e67d613a77ec tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:15.787099 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-058e201c-a378-4d22-bf79-e67d613a77ec tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:15.797880 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-058e201c-a378-4d22-bf79-e67d613a77ec tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:15.798668 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-058e201c-a378-4d22-bf79-e67d613a77ec tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:15.799997 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-058e201c-a378-4d22-bf79-e67d613a77ec tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:15.800741 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-058e201c-a378-4d22-bf79-e67d613a77ec tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:15.941499 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-058e201c-a378-4d22-bf79-e67d613a77ec tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:15.953212 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-058e201c-a378-4d22-bf79-e67d613a77ec tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.172566 Dec 23 12:03:15.954025 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 316/594] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:15 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:16.000957 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2623d871-8ea9-4fcd-8781-89ded4f1d112 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:16.001535 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2623d871-8ea9-4fcd-8781-89ded4f1d112 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:16.008312 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2623d871-8ea9-4fcd-8781-89ded4f1d112 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:16.008842 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2623d871-8ea9-4fcd-8781-89ded4f1d112 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:16.009645 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2623d871-8ea9-4fcd-8781-89ded4f1d112 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:16.010080 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2623d871-8ea9-4fcd-8781-89ded4f1d112 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:16.156973 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-2623d871-8ea9-4fcd-8781-89ded4f1d112 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:16.164429 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2623d871-8ea9-4fcd-8781-89ded4f1d112 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 200 len: 1318 microversion: 2.1 time: 0.167290 Dec 23 12:03:16.165067 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 279/595] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:15 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:16.975077 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ac47e347-1ca4-4c18-8cab-bc264ec0d844 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:16.975964 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ac47e347-1ca4-4c18-8cab-bc264ec0d844 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:16.983382 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ac47e347-1ca4-4c18-8cab-bc264ec0d844 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:16.983840 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ac47e347-1ca4-4c18-8cab-bc264ec0d844 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:16.984994 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ac47e347-1ca4-4c18-8cab-bc264ec0d844 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:16.985431 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ac47e347-1ca4-4c18-8cab-bc264ec0d844 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:17.132450 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ac47e347-1ca4-4c18-8cab-bc264ec0d844 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:17.142764 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ac47e347-1ca4-4c18-8cab-bc264ec0d844 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.173863 Dec 23 12:03:17.143800 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 317/596] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:16 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:17.188617 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-012aed68-d81d-4cd4-9546-51fda840384c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:17.189486 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-012aed68-d81d-4cd4-9546-51fda840384c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:17.198575 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-012aed68-d81d-4cd4-9546-51fda840384c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:17.199272 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-012aed68-d81d-4cd4-9546-51fda840384c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:17.200384 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-012aed68-d81d-4cd4-9546-51fda840384c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:17.201007 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-012aed68-d81d-4cd4-9546-51fda840384c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:17.338954 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-012aed68-d81d-4cd4-9546-51fda840384c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:17.347078 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-012aed68-d81d-4cd4-9546-51fda840384c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 200 len: 1318 microversion: 2.1 time: 0.163697 Dec 23 12:03:17.347649 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 280/597] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:17 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:18.164371 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-83c0cda4-1379-4957-8bc9-db0f4188759d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:18.165343 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-83c0cda4-1379-4957-8bc9-db0f4188759d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:18.176053 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-83c0cda4-1379-4957-8bc9-db0f4188759d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:18.176800 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-83c0cda4-1379-4957-8bc9-db0f4188759d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:18.178089 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-83c0cda4-1379-4957-8bc9-db0f4188759d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:18.178891 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-83c0cda4-1379-4957-8bc9-db0f4188759d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:18.321709 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-83c0cda4-1379-4957-8bc9-db0f4188759d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:18.331701 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-83c0cda4-1379-4957-8bc9-db0f4188759d tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1522 microversion: 2.1 time: 0.173248 Dec 23 12:03:18.332428 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 318/598] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:18 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:18.364293 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-49e4363a-350a-42b6-9e8b-92dc6fb5bf3f tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:18.364920 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-49e4363a-350a-42b6-9e8b-92dc6fb5bf3f tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:18.371642 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-49e4363a-350a-42b6-9e8b-92dc6fb5bf3f tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:18.372125 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-49e4363a-350a-42b6-9e8b-92dc6fb5bf3f tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:18.372886 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-49e4363a-350a-42b6-9e8b-92dc6fb5bf3f tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:18.373312 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-49e4363a-350a-42b6-9e8b-92dc6fb5bf3f tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:18.506576 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-49e4363a-350a-42b6-9e8b-92dc6fb5bf3f tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:18.514739 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-49e4363a-350a-42b6-9e8b-92dc6fb5bf3f tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 200 len: 1318 microversion: 2.1 time: 0.154024 Dec 23 12:03:18.515307 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 281/599] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:18 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:19.361971 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4fc13ee3-7bb6-4a69-b139-4492c9273afe tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:19.362389 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4fc13ee3-7bb6-4a69-b139-4492c9273afe tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:19.371861 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4fc13ee3-7bb6-4a69-b139-4492c9273afe tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:19.372315 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4fc13ee3-7bb6-4a69-b139-4492c9273afe tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:19.373105 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4fc13ee3-7bb6-4a69-b139-4492c9273afe tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:19.373563 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4fc13ee3-7bb6-4a69-b139-4492c9273afe tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:19.392263 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-ba8add25-5d9e-4f8f-b13e-d926f5b3166a req-5030ce4a-2691-4e97-8c77-2e10623d0782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f88906-0a5f-47a4-bf35-55db395a0e97", "name": "network-vif-deleted", "tag": "b32d0851-1880-4e36-81d6-464702876f58"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:19.393804 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:03:19.393804 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:03:19.402877 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-ba8add25-5d9e-4f8f-b13e-d926f5b3166a req-5030ce4a-2691-4e97-8c77-2e10623d0782 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:19.403231 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-ba8add25-5d9e-4f8f-b13e-d926f5b3166a req-5030ce4a-2691-4e97-8c77-2e10623d0782 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:19.414566 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-ba8add25-5d9e-4f8f-b13e-d926f5b3166a req-5030ce4a-2691-4e97-8c77-2e10623d0782 service nova] Creating event network-vif-deleted:b32d0851-1880-4e36-81d6-464702876f58 for instance 15f88906-0a5f-47a4-bf35-55db395a0e97 on hv-cinder-82282 Dec 23 12:03:19.419659 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-ba8add25-5d9e-4f8f-b13e-d926f5b3166a req-5030ce4a-2691-4e97-8c77-2e10623d0782 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030936 Dec 23 12:03:19.420961 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 282/600] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:03:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:03:19.443051 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4fc13ee3-7bb6-4a69-b139-4492c9273afe tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f3bd3c1142aca50069a45a26aaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec59363a116e4c37832626c6add07f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:19.450617 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4fc13ee3-7bb6-4a69-b139-4492c9273afe tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 200 len: 1480 microversion: 2.1 time: 0.096380 Dec 23 12:03:19.451181 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 319/601] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:19 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 1480 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:19.532545 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-909d6c06-d64e-4233-ad7e-f6f6a854359e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:19.533252 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-909d6c06-d64e-4233-ad7e-f6f6a854359e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:19.539992 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-909d6c06-d64e-4233-ad7e-f6f6a854359e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:19.540432 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-909d6c06-d64e-4233-ad7e-f6f6a854359e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:19.541241 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-909d6c06-d64e-4233-ad7e-f6f6a854359e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:19.541718 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-909d6c06-d64e-4233-ad7e-f6f6a854359e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:19.672828 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-909d6c06-d64e-4233-ad7e-f6f6a854359e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:19.680272 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-909d6c06-d64e-4233-ad7e-f6f6a854359e tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 200 len: 1318 microversion: 2.1 time: 0.151889 Dec 23 12:03:19.680882 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 283/602] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:19 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:20.471324 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d56b83c3-7fe4-4a6e-b4d4-966b014ef580 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:20.472341 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d56b83c3-7fe4-4a6e-b4d4-966b014ef580 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] [instance: 15f88906-0a5f-47a4-bf35-55db395a0e97] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:20.483404 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d56b83c3-7fe4-4a6e-b4d4-966b014ef580 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:20.484154 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d56b83c3-7fe4-4a6e-b4d4-966b014ef580 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:20.485830 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d56b83c3-7fe4-4a6e-b4d4-966b014ef580 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:20.486589 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d56b83c3-7fe4-4a6e-b4d4-966b014ef580 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:20.502852 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-d56b83c3-7fe4-4a6e-b4d4-966b014ef580 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] HTTP exception thrown: Instance 15f88906-0a5f-47a4-bf35-55db395a0e97 could not be found. Dec 23 12:03:20.503438 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d56b83c3-7fe4-4a6e-b4d4-966b014ef580 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] Returning 404 to user: Instance 15f88906-0a5f-47a4-bf35-55db395a0e97 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:03:20.504281 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d56b83c3-7fe4-4a6e-b4d4-966b014ef580 tempest-ServerRescueNegativeTestJSON-1616557576 tempest-ServerRescueNegativeTestJSON-1616557576-project] 10.222.0.65 "GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97" status: 404 len: 111 microversion: 2.1 time: 0.039236 Dec 23 12:03:20.504799 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 320/603] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:20 2021] GET /compute/v2.1/servers/15f88906-0a5f-47a4-bf35-55db395a0e97 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:03:20.697296 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ccaec9ee-5b78-42bb-ab3e-bdcd4a53869a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:20.697971 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ccaec9ee-5b78-42bb-ab3e-bdcd4a53869a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:20.704653 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ccaec9ee-5b78-42bb-ab3e-bdcd4a53869a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:20.705105 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ccaec9ee-5b78-42bb-ab3e-bdcd4a53869a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:20.705880 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ccaec9ee-5b78-42bb-ab3e-bdcd4a53869a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:20.706297 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ccaec9ee-5b78-42bb-ab3e-bdcd4a53869a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:20.910280 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ccaec9ee-5b78-42bb-ab3e-bdcd4a53869a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:20.918091 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ccaec9ee-5b78-42bb-ab3e-bdcd4a53869a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 200 len: 1318 microversion: 2.1 time: 0.224532 Dec 23 12:03:20.918646 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 284/604] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:20 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:21.098456 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-19101fed-af31-435b-af5d-7c2350a1a367 req-99c7f964-af22-4dcf-adf2-75bd76c6d053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4ca63a-c7c0-4b76-877d-bd3963a3d552", "name": "network-vif-plugged", "status": "completed", "tag": "a7278194-1bcb-422c-b9af-18f3d0d578cc"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:21.100161 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:03:21.100161 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:03:21.108895 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-19101fed-af31-435b-af5d-7c2350a1a367 req-99c7f964-af22-4dcf-adf2-75bd76c6d053 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:21.109900 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-19101fed-af31-435b-af5d-7c2350a1a367 req-99c7f964-af22-4dcf-adf2-75bd76c6d053 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:21.124698 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-19101fed-af31-435b-af5d-7c2350a1a367 req-99c7f964-af22-4dcf-adf2-75bd76c6d053 service nova] Creating event network-vif-plugged:a7278194-1bcb-422c-b9af-18f3d0d578cc for instance 4e4ca63a-c7c0-4b76-877d-bd3963a3d552 on hv-cinder-82282 Dec 23 12:03:21.130309 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-19101fed-af31-435b-af5d-7c2350a1a367 req-99c7f964-af22-4dcf-adf2-75bd76c6d053 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036238 Dec 23 12:03:21.131229 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 321/605] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:03:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:03:21.935115 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b55e4f3d-c823-47bf-84d4-0d3a688701c9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:21.935740 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b55e4f3d-c823-47bf-84d4-0d3a688701c9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:21.943993 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b55e4f3d-c823-47bf-84d4-0d3a688701c9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:21.944587 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b55e4f3d-c823-47bf-84d4-0d3a688701c9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:21.945722 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b55e4f3d-c823-47bf-84d4-0d3a688701c9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:21.946388 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b55e4f3d-c823-47bf-84d4-0d3a688701c9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:22.171533 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b55e4f3d-c823-47bf-84d4-0d3a688701c9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:22.179243 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b55e4f3d-c823-47bf-84d4-0d3a688701c9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 200 len: 1318 microversion: 2.1 time: 0.247921 Dec 23 12:03:22.179806 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 285/606] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:21 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:23.196983 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5a9d812d-f814-42a5-b941-8a0a2acb3bee tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:23.197672 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5a9d812d-f814-42a5-b941-8a0a2acb3bee tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:23.205648 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5a9d812d-f814-42a5-b941-8a0a2acb3bee tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:23.206206 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5a9d812d-f814-42a5-b941-8a0a2acb3bee tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:23.207400 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5a9d812d-f814-42a5-b941-8a0a2acb3bee tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:23.208051 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5a9d812d-f814-42a5-b941-8a0a2acb3bee tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:23.407206 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-5a9d812d-f814-42a5-b941-8a0a2acb3bee tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:23.414522 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5a9d812d-f814-42a5-b941-8a0a2acb3bee tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 200 len: 1507 microversion: 2.1 time: 0.221854 Dec 23 12:03:23.415225 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 322/607] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:23 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 1507 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:23.430989 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-60d411ea-68bd-471e-aada-4b69f9c31757 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68dfdb65-eb7a-4ffa-83a8-f668773a6291", "device": "/dev/sdb"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:23.432192 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-60d411ea-68bd-471e-aada-4b69f9c31757 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:23.438544 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-60d411ea-68bd-471e-aada-4b69f9c31757 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:23.439031 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-60d411ea-68bd-471e-aada-4b69f9c31757 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:23.439800 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-60d411ea-68bd-471e-aada-4b69f9c31757 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:23.440229 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-60d411ea-68bd-471e-aada-4b69f9c31757 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:23.715026 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-60d411ea-68bd-471e-aada-4b69f9c31757 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "POST /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287798 Dec 23 12:03:23.715653 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 286/608] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Dec 23 12:03:23 2021] POST /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 12:03:29.378080 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-247ac0b4-84da-4140-9030-b1802ab053f7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'create', calling method: .version_select at 0x7fcf286ecca0>, body: {"keypair": {"name": "tempest-keypair-1179936899"}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:29.392402 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-247ac0b4-84da-4140-9030-b1802ab053f7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Getting quotas for project 83a1e536ed4249adb353b71e8bf03cfd. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:03:29.396398 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-247ac0b4-84da-4140-9030-b1802ab053f7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Getting quotas for user a351cbc96e894a03906076d2652272a3 and project 83a1e536ed4249adb353b71e8bf03cfd. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:03:29.719347 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-247ac0b4-84da-4140-9030-b1802ab053f7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Getting quotas for project 83a1e536ed4249adb353b71e8bf03cfd. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:03:29.723066 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-247ac0b4-84da-4140-9030-b1802ab053f7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Getting quotas for user a351cbc96e894a03906076d2652272a3 and project 83a1e536ed4249adb353b71e8bf03cfd. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:03:29.736474 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-247ac0b4-84da-4140-9030-b1802ab053f7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.481611 Dec 23 12:03:29.737076 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 323/609] 10.222.0.65 () {60 vars in 1157 bytes} [Thu Dec 23 12:03:29 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:31.018361 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-89f4d1a3-aec7-4454-bea8-b2dc9403b9fd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-144838674", "imageRef": "938a78c0-341e-4043-927a-9bfe8cf52508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60b7dd52-a57d-43ce-8b05-529205e80faf"}], "security_groups": [{"name": "tempest-securitygroup--433497222"}], "key_name": "tempest-keypair-1179936899", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:31.290201 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.network.neutron [None req-89f4d1a3-aec7-4454-bea8-b2dc9403b9fd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] validate_networks() for [('60b7dd52-a57d-43ce-8b05-529205e80faf', None, None, None, None, None)] {{(pid=116355) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 12:03:31.693282 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-89f4d1a3-aec7-4454-bea8-b2dc9403b9fd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Flavor limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 12:03:31.693710 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-89f4d1a3-aec7-4454-bea8-b2dc9403b9fd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Image limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 12:03:31.694167 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-89f4d1a3-aec7-4454-bea8-b2dc9403b9fd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Flavor pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 12:03:31.694833 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-89f4d1a3-aec7-4454-bea8-b2dc9403b9fd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Image pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 12:03:31.695588 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-89f4d1a3-aec7-4454-bea8-b2dc9403b9fd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 12:03:31.705921 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-89f4d1a3-aec7-4454-bea8-b2dc9403b9fd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:31.706916 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-89f4d1a3-aec7-4454-bea8-b2dc9403b9fd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:31.707593 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-89f4d1a3-aec7-4454-bea8-b2dc9403b9fd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:31.708129 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-89f4d1a3-aec7-4454-bea8-b2dc9403b9fd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:31.726554 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-89f4d1a3-aec7-4454-bea8-b2dc9403b9fd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Getting quotas for project 83a1e536ed4249adb353b71e8bf03cfd. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:03:31.731398 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-89f4d1a3-aec7-4454-bea8-b2dc9403b9fd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Getting quotas for user a351cbc96e894a03906076d2652272a3 and project 83a1e536ed4249adb353b71e8bf03cfd. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:03:31.743593 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-89f4d1a3-aec7-4454-bea8-b2dc9403b9fd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Going to run 1 instances... {{(pid=116355) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 12:03:31.746657 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-89f4d1a3-aec7-4454-bea8-b2dc9403b9fd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='938a78c0-341e-4043-927a-9bfe8cf52508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 12:03:31.795044 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-89f4d1a3-aec7-4454-bea8-b2dc9403b9fd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.781530 Dec 23 12:03:31.800459 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 287/610] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 12:03:31 2021] POST /compute/v2.1/servers => generated 401 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 12:03:31.806208 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-41da056f-7fce-4c66-a409-b2db5a239d7e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:31.810071 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-41da056f-7fce-4c66-a409-b2db5a239d7e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:31.960925 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-41da056f-7fce-4c66-a409-b2db5a239d7e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:31.970701 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-41da056f-7fce-4c66-a409-b2db5a239d7e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1237 microversion: 2.1 time: 0.168724 Dec 23 12:03:31.971619 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 324/611] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:31 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1237 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:32.987545 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-7a6785f1-72c1-4269-9ced-50e3d8af8d7a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:32.988102 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-7a6785f1-72c1-4269-9ced-50e3d8af8d7a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:32.994786 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7a6785f1-72c1-4269-9ced-50e3d8af8d7a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:32.995244 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7a6785f1-72c1-4269-9ced-50e3d8af8d7a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:32.996036 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7a6785f1-72c1-4269-9ced-50e3d8af8d7a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:32.996451 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7a6785f1-72c1-4269-9ced-50e3d8af8d7a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:33.063228 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-7a6785f1-72c1-4269-9ced-50e3d8af8d7a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:33.070977 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-7a6785f1-72c1-4269-9ced-50e3d8af8d7a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1241 microversion: 2.1 time: 0.088000 Dec 23 12:03:33.071540 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 288/612] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:32 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:34.089656 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0a5d9cec-a9a1-495b-ac9f-d5d09d348ebb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:34.090254 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0a5d9cec-a9a1-495b-ac9f-d5d09d348ebb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:34.099830 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0a5d9cec-a9a1-495b-ac9f-d5d09d348ebb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:34.100445 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0a5d9cec-a9a1-495b-ac9f-d5d09d348ebb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:34.101544 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0a5d9cec-a9a1-495b-ac9f-d5d09d348ebb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:34.102062 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0a5d9cec-a9a1-495b-ac9f-d5d09d348ebb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:34.165474 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0a5d9cec-a9a1-495b-ac9f-d5d09d348ebb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:34.175065 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0a5d9cec-a9a1-495b-ac9f-d5d09d348ebb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1241 microversion: 2.1 time: 0.089314 Dec 23 12:03:34.175667 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 325/613] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:34 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:35.197076 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2128dd18-1991-4f82-92be-44a4e8753692 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:35.197655 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2128dd18-1991-4f82-92be-44a4e8753692 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:35.204881 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2128dd18-1991-4f82-92be-44a4e8753692 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:35.205335 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2128dd18-1991-4f82-92be-44a4e8753692 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:35.206106 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2128dd18-1991-4f82-92be-44a4e8753692 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:35.206539 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2128dd18-1991-4f82-92be-44a4e8753692 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:35.274286 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-2128dd18-1991-4f82-92be-44a4e8753692 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:35.282474 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2128dd18-1991-4f82-92be-44a4e8753692 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1241 microversion: 2.1 time: 0.091164 Dec 23 12:03:35.283218 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 289/614] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:35 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:35.641428 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3e1af718-9cd9-4470-abbc-ba8bca07630a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:35.641917 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3e1af718-9cd9-4470-abbc-ba8bca07630a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:35.649457 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3e1af718-9cd9-4470-abbc-ba8bca07630a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:35.649959 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3e1af718-9cd9-4470-abbc-ba8bca07630a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:35.651336 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3e1af718-9cd9-4470-abbc-ba8bca07630a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:35.651805 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3e1af718-9cd9-4470-abbc-ba8bca07630a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:35.683297 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3e1af718-9cd9-4470-abbc-ba8bca07630a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments/57b62b99-6cdd-4410-8e8e-07aa2402c709" status: 200 len: 194 microversion: 2.20 time: 0.045554 Dec 23 12:03:35.684006 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 326/615] 10.222.0.65 () {60 vars in 1453 bytes} [Thu Dec 23 12:03:35 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments/57b62b99-6cdd-4410-8e8e-07aa2402c709 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:03:35.756525 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b872c1b5-a4df-457c-9bc3-bf8cbf8657e3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:35.757159 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b872c1b5-a4df-457c-9bc3-bf8cbf8657e3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:35.765482 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b872c1b5-a4df-457c-9bc3-bf8cbf8657e3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:35.766125 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b872c1b5-a4df-457c-9bc3-bf8cbf8657e3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:35.767357 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b872c1b5-a4df-457c-9bc3-bf8cbf8657e3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:35.767995 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b872c1b5-a4df-457c-9bc3-bf8cbf8657e3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:35.856672 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.objects.instance [None req-b872c1b5-a4df-457c-9bc3-bf8cbf8657e3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lazy-loading 'services' on Instance uuid fc998144-5288-467f-82de-9c1983559e40 {{(pid=116355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:03:35.933463 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b872c1b5-a4df-457c-9bc3-bf8cbf8657e3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "DELETE /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments/57b62b99-6cdd-4410-8e8e-07aa2402c709" status: 202 len: 0 microversion: 2.20 time: 0.182002 Dec 23 12:03:35.934097 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 290/616] 10.222.0.65 () {60 vars in 1456 bytes} [Thu Dec 23 12:03:35 2021] DELETE /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments/57b62b99-6cdd-4410-8e8e-07aa2402c709 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:03:35.942439 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-6d2bbec6-78fb-414b-90bd-4f2f3051f306 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:35.943490 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-6d2bbec6-78fb-414b-90bd-4f2f3051f306 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:35.949827 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6d2bbec6-78fb-414b-90bd-4f2f3051f306 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:35.950463 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6d2bbec6-78fb-414b-90bd-4f2f3051f306 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:35.951131 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6d2bbec6-78fb-414b-90bd-4f2f3051f306 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:35.951572 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6d2bbec6-78fb-414b-90bd-4f2f3051f306 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:35.981471 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-6d2bbec6-78fb-414b-90bd-4f2f3051f306 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042880 Dec 23 12:03:35.982035 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 327/617] 10.222.0.65 () {60 vars in 1342 bytes} [Thu Dec 23 12:03:35 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:03:36.299853 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-df4bdddd-f41a-4a75-b4b0-13eab2829cc4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:36.300553 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-df4bdddd-f41a-4a75-b4b0-13eab2829cc4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:36.306978 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-df4bdddd-f41a-4a75-b4b0-13eab2829cc4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:36.307345 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-df4bdddd-f41a-4a75-b4b0-13eab2829cc4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:36.308496 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-df4bdddd-f41a-4a75-b4b0-13eab2829cc4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:36.308634 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-df4bdddd-f41a-4a75-b4b0-13eab2829cc4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:36.372091 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-df4bdddd-f41a-4a75-b4b0-13eab2829cc4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:36.379929 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-df4bdddd-f41a-4a75-b4b0-13eab2829cc4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1297 microversion: 2.1 time: 0.084666 Dec 23 12:03:36.380488 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 291/618] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:36 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:36.993562 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8d243893-1e5d-462b-9a28-14c94b07f6fb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:36.994479 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8d243893-1e5d-462b-9a28-14c94b07f6fb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:37.000826 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d243893-1e5d-462b-9a28-14c94b07f6fb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:37.001274 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d243893-1e5d-462b-9a28-14c94b07f6fb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:37.002052 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d243893-1e5d-462b-9a28-14c94b07f6fb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:37.002490 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d243893-1e5d-462b-9a28-14c94b07f6fb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:37.033066 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8d243893-1e5d-462b-9a28-14c94b07f6fb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043225 Dec 23 12:03:37.033690 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 328/619] 10.222.0.65 () {60 vars in 1342 bytes} [Thu Dec 23 12:03:36 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:03:37.400290 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-fc0effdc-7f0f-4001-899e-f2932c6b49c7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:37.400872 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-fc0effdc-7f0f-4001-899e-f2932c6b49c7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:37.410128 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fc0effdc-7f0f-4001-899e-f2932c6b49c7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:37.410831 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fc0effdc-7f0f-4001-899e-f2932c6b49c7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:37.411801 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fc0effdc-7f0f-4001-899e-f2932c6b49c7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:37.412337 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fc0effdc-7f0f-4001-899e-f2932c6b49c7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:37.549757 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-fc0effdc-7f0f-4001-899e-f2932c6b49c7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:37.558699 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-fc0effdc-7f0f-4001-899e-f2932c6b49c7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1362 microversion: 2.1 time: 0.163998 Dec 23 12:03:37.559687 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 292/620] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:37 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:38.049207 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2a7df461-4f49-4b55-b9a8-9c0395f509de tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:38.050773 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2a7df461-4f49-4b55-b9a8-9c0395f509de tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:38.060543 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2a7df461-4f49-4b55-b9a8-9c0395f509de tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:38.060993 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2a7df461-4f49-4b55-b9a8-9c0395f509de tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:38.061797 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2a7df461-4f49-4b55-b9a8-9c0395f509de tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:38.062242 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2a7df461-4f49-4b55-b9a8-9c0395f509de tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:38.094016 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2a7df461-4f49-4b55-b9a8-9c0395f509de tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051773 Dec 23 12:03:38.094632 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 329/621] 10.222.0.65 () {60 vars in 1342 bytes} [Thu Dec 23 12:03:38 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:03:38.578384 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b2230222-ca9f-4bdd-8b83-3d7978e3f208 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:38.579076 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b2230222-ca9f-4bdd-8b83-3d7978e3f208 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:38.585643 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b2230222-ca9f-4bdd-8b83-3d7978e3f208 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:38.586097 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b2230222-ca9f-4bdd-8b83-3d7978e3f208 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:38.586907 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b2230222-ca9f-4bdd-8b83-3d7978e3f208 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:38.587350 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b2230222-ca9f-4bdd-8b83-3d7978e3f208 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:38.733983 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b2230222-ca9f-4bdd-8b83-3d7978e3f208 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:38.742032 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b2230222-ca9f-4bdd-8b83-3d7978e3f208 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1362 microversion: 2.1 time: 0.168031 Dec 23 12:03:38.742342 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 293/622] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:38 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:39.108670 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2c0cb510-6741-4581-a2df-3a2d9af3570b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:39.110043 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2c0cb510-6741-4581-a2df-3a2d9af3570b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:39.117443 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2c0cb510-6741-4581-a2df-3a2d9af3570b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:39.117941 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2c0cb510-6741-4581-a2df-3a2d9af3570b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:39.118836 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2c0cb510-6741-4581-a2df-3a2d9af3570b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:39.119316 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2c0cb510-6741-4581-a2df-3a2d9af3570b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:39.157074 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2c0cb510-6741-4581-a2df-3a2d9af3570b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053404 Dec 23 12:03:39.157799 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 330/623] 10.222.0.65 () {60 vars in 1342 bytes} [Thu Dec 23 12:03:39 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:03:39.762962 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d3f8c56d-f7b8-48fa-9e28-419abeab99b4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:39.763565 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d3f8c56d-f7b8-48fa-9e28-419abeab99b4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:39.770725 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d3f8c56d-f7b8-48fa-9e28-419abeab99b4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:39.771204 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d3f8c56d-f7b8-48fa-9e28-419abeab99b4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:39.772031 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d3f8c56d-f7b8-48fa-9e28-419abeab99b4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:39.772488 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d3f8c56d-f7b8-48fa-9e28-419abeab99b4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:39.909573 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d3f8c56d-f7b8-48fa-9e28-419abeab99b4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:39.920139 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d3f8c56d-f7b8-48fa-9e28-419abeab99b4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1362 microversion: 2.1 time: 0.163216 Dec 23 12:03:39.920695 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 294/624] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:39 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:40.296336 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-fe71f4da-87e0-4b45-a67b-8500a8226081 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:40.297264 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-fe71f4da-87e0-4b45-a67b-8500a8226081 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:40.303706 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fe71f4da-87e0-4b45-a67b-8500a8226081 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:40.304162 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fe71f4da-87e0-4b45-a67b-8500a8226081 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:40.304949 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fe71f4da-87e0-4b45-a67b-8500a8226081 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:40.305389 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fe71f4da-87e0-4b45-a67b-8500a8226081 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:40.335041 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-fe71f4da-87e0-4b45-a67b-8500a8226081 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.167174 Dec 23 12:03:40.335598 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 331/625] 10.222.0.65 () {60 vars in 1342 bytes} [Thu Dec 23 12:03:40 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:03:40.942624 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-295f2eba-97f8-481a-9776-9fff8c002fb8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:40.943214 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-295f2eba-97f8-481a-9776-9fff8c002fb8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:40.950115 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-295f2eba-97f8-481a-9776-9fff8c002fb8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:40.950618 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-295f2eba-97f8-481a-9776-9fff8c002fb8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:40.951381 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-295f2eba-97f8-481a-9776-9fff8c002fb8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:40.951811 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-295f2eba-97f8-481a-9776-9fff8c002fb8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:41.236635 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-295f2eba-97f8-481a-9776-9fff8c002fb8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:41.244654 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-295f2eba-97f8-481a-9776-9fff8c002fb8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1362 microversion: 2.1 time: 0.305772 Dec 23 12:03:41.245312 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 295/626] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:40 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:41.349592 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-86227ea9-57da-47d5-8210-1178f389100c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:41.351413 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-86227ea9-57da-47d5-8210-1178f389100c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:41.358464 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-86227ea9-57da-47d5-8210-1178f389100c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:41.359230 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-86227ea9-57da-47d5-8210-1178f389100c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:41.360796 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-86227ea9-57da-47d5-8210-1178f389100c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:41.360914 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-86227ea9-57da-47d5-8210-1178f389100c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:41.393067 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-86227ea9-57da-47d5-8210-1178f389100c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047252 Dec 23 12:03:41.393861 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 332/627] 10.222.0.65 () {60 vars in 1342 bytes} [Thu Dec 23 12:03:41 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:03:41.801618 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-bc4d305d-8b81-48c2-99da-c76bdc7925a2 req-9614c6d7-1fe1-4a3d-89aa-cd56e72afe79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b18df5-9ce3-44cb-8a62-730a959e46ac", "tag": "e8ea114b-8a29-4d6d-a634-848c94498c32"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:41.803572 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:03:41.803572 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:03:41.815003 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-bc4d305d-8b81-48c2-99da-c76bdc7925a2 req-9614c6d7-1fe1-4a3d-89aa-cd56e72afe79 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:41.815818 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-bc4d305d-8b81-48c2-99da-c76bdc7925a2 req-9614c6d7-1fe1-4a3d-89aa-cd56e72afe79 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:41.831947 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-bc4d305d-8b81-48c2-99da-c76bdc7925a2 req-9614c6d7-1fe1-4a3d-89aa-cd56e72afe79 service nova] Creating event network-changed:e8ea114b-8a29-4d6d-a634-848c94498c32 for instance f3b18df5-9ce3-44cb-8a62-730a959e46ac on hv-cinder-82282 Dec 23 12:03:41.840696 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-bc4d305d-8b81-48c2-99da-c76bdc7925a2 req-9614c6d7-1fe1-4a3d-89aa-cd56e72afe79 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051007 Dec 23 12:03:41.841589 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 296/628] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:03:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:03:42.261440 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-23866d62-f0d6-45bc-8aed-fa54fefe7a95 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:42.262083 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-23866d62-f0d6-45bc-8aed-fa54fefe7a95 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:42.268269 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-23866d62-f0d6-45bc-8aed-fa54fefe7a95 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:42.268779 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-23866d62-f0d6-45bc-8aed-fa54fefe7a95 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:42.269911 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-23866d62-f0d6-45bc-8aed-fa54fefe7a95 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:42.270641 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-23866d62-f0d6-45bc-8aed-fa54fefe7a95 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:42.406260 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-673bc41f-76fd-467a-9ba0-106c728219d9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:42.407277 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-673bc41f-76fd-467a-9ba0-106c728219d9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:42.414163 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-673bc41f-76fd-467a-9ba0-106c728219d9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:42.414638 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-673bc41f-76fd-467a-9ba0-106c728219d9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:42.415437 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-673bc41f-76fd-467a-9ba0-106c728219d9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:42.415868 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-673bc41f-76fd-467a-9ba0-106c728219d9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:42.447602 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-673bc41f-76fd-467a-9ba0-106c728219d9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046041 Dec 23 12:03:42.448387 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 297/629] 10.222.0.65 () {60 vars in 1342 bytes} [Thu Dec 23 12:03:42 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:42.508834 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3b4a9c41-fe0c-40a4-bdc8-06cab89727cd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:42.509327 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3b4a9c41-fe0c-40a4-bdc8-06cab89727cd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:42.515458 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3b4a9c41-fe0c-40a4-bdc8-06cab89727cd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:42.515904 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3b4a9c41-fe0c-40a4-bdc8-06cab89727cd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:42.516716 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3b4a9c41-fe0c-40a4-bdc8-06cab89727cd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:42.517143 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3b4a9c41-fe0c-40a4-bdc8-06cab89727cd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:42.542675 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3b4a9c41-fe0c-40a4-bdc8-06cab89727cd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Going to try to terminate instance {{(pid=116355) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:03:42.625806 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3b4a9c41-fe0c-40a4-bdc8-06cab89727cd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "DELETE /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 204 len: 0 microversion: 2.20 time: 0.120399 Dec 23 12:03:42.626847 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 298/630] 10.222.0.65 () {60 vars in 1279 bytes} [Thu Dec 23 12:03:42 2021] DELETE /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 23 12:03:42.637715 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-9ae09d28-72bb-41e0-b3c7-00d85aa3ff34 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:42.638875 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-9ae09d28-72bb-41e0-b3c7-00d85aa3ff34 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:42.644894 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9ae09d28-72bb-41e0-b3c7-00d85aa3ff34 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:42.645345 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9ae09d28-72bb-41e0-b3c7-00d85aa3ff34 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:42.646129 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9ae09d28-72bb-41e0-b3c7-00d85aa3ff34 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:42.646615 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9ae09d28-72bb-41e0-b3c7-00d85aa3ff34 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:42.701974 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-23866d62-f0d6-45bc-8aed-fa54fefe7a95 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:42.709296 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-23866d62-f0d6-45bc-8aed-fa54fefe7a95 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1362 microversion: 2.1 time: 0.451632 Dec 23 12:03:42.709850 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 333/631] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:42 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1362 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:42.788008 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-9ae09d28-72bb-41e0-b3c7-00d85aa3ff34 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:42.796753 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-9ae09d28-72bb-41e0-b3c7-00d85aa3ff34 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:42.798149 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-9ae09d28-72bb-41e0-b3c7-00d85aa3ff34 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:42.799324 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-9ae09d28-72bb-41e0-b3c7-00d85aa3ff34 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.167745 Dec 23 12:03:42.799905 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 299/632] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:03:42 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:03:43.727219 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-94f6b2b5-4d58-4a13-bc71-f73ed9056053 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:43.727804 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-94f6b2b5-4d58-4a13-bc71-f73ed9056053 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:43.735274 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-94f6b2b5-4d58-4a13-bc71-f73ed9056053 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:43.735753 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-94f6b2b5-4d58-4a13-bc71-f73ed9056053 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:43.736587 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-94f6b2b5-4d58-4a13-bc71-f73ed9056053 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:43.737050 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-94f6b2b5-4d58-4a13-bc71-f73ed9056053 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:43.817375 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3e84518b-e611-4956-96d3-a4d78e620309 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:43.818052 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3e84518b-e611-4956-96d3-a4d78e620309 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:43.824746 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3e84518b-e611-4956-96d3-a4d78e620309 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:43.825300 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3e84518b-e611-4956-96d3-a4d78e620309 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:43.826202 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3e84518b-e611-4956-96d3-a4d78e620309 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:43.826657 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3e84518b-e611-4956-96d3-a4d78e620309 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:43.882906 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-94f6b2b5-4d58-4a13-bc71-f73ed9056053 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:43.891085 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-94f6b2b5-4d58-4a13-bc71-f73ed9056053 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1362 microversion: 2.1 time: 0.167881 Dec 23 12:03:43.891662 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 334/633] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:43 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:43.970327 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3e84518b-e611-4956-96d3-a4d78e620309 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:43.982755 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3e84518b-e611-4956-96d3-a4d78e620309 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:43.985147 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3e84518b-e611-4956-96d3-a4d78e620309 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:43.987157 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3e84518b-e611-4956-96d3-a4d78e620309 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.173037 Dec 23 12:03:43.987881 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 300/634] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:03:43 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:03:44.908262 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8937fd0b-b0bf-499a-8a8b-840404b0d196 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:44.909038 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8937fd0b-b0bf-499a-8a8b-840404b0d196 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:44.915698 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8937fd0b-b0bf-499a-8a8b-840404b0d196 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:44.916149 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8937fd0b-b0bf-499a-8a8b-840404b0d196 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:44.916926 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8937fd0b-b0bf-499a-8a8b-840404b0d196 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:44.917387 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8937fd0b-b0bf-499a-8a8b-840404b0d196 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:45.009172 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d484b16c-e4ad-4f7c-8f61-17a4247b3c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:45.009661 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d484b16c-e4ad-4f7c-8f61-17a4247b3c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:45.017063 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d484b16c-e4ad-4f7c-8f61-17a4247b3c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:45.017821 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d484b16c-e4ad-4f7c-8f61-17a4247b3c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:45.018950 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d484b16c-e4ad-4f7c-8f61-17a4247b3c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:45.019782 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d484b16c-e4ad-4f7c-8f61-17a4247b3c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:45.060859 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8937fd0b-b0bf-499a-8a8b-840404b0d196 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:45.068194 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8937fd0b-b0bf-499a-8a8b-840404b0d196 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1362 microversion: 2.1 time: 0.163560 Dec 23 12:03:45.068774 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 335/635] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:44 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:45.156456 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d484b16c-e4ad-4f7c-8f61-17a4247b3c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:45.165285 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d484b16c-e4ad-4f7c-8f61-17a4247b3c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:45.166807 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d484b16c-e4ad-4f7c-8f61-17a4247b3c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:45.168920 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d484b16c-e4ad-4f7c-8f61-17a4247b3c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.163332 Dec 23 12:03:45.169481 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 301/636] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:03:45 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:03:45.186017 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1e3d8bb0-ee0b-45a4-a57d-4515fa85c7c7 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:45.186541 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1e3d8bb0-ee0b-45a4-a57d-4515fa85c7c7 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:45.192782 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1e3d8bb0-ee0b-45a4-a57d-4515fa85c7c7 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:45.193179 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1e3d8bb0-ee0b-45a4-a57d-4515fa85c7c7 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:45.193970 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1e3d8bb0-ee0b-45a4-a57d-4515fa85c7c7 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:45.194406 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1e3d8bb0-ee0b-45a4-a57d-4515fa85c7c7 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:45.274434 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-1e3d8bb0-ee0b-45a4-a57d-4515fa85c7c7 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lazy-loading 'services' on Instance uuid 4e4ca63a-c7c0-4b76-877d-bd3963a3d552 {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:03:45.387781 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1e3d8bb0-ee0b-45a4-a57d-4515fa85c7c7 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552/os-volume_attachments/68dfdb65-eb7a-4ffa-83a8-f668773a6291" status: 202 len: 0 microversion: 2.1 time: 0.205798 Dec 23 12:03:45.388372 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 336/637] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Dec 23 12:03:45 2021] DELETE /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552/os-volume_attachments/68dfdb65-eb7a-4ffa-83a8-f668773a6291 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:03:46.085283 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-7d69e162-9f3b-4fea-ab6a-468050ea101a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:46.085882 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-7d69e162-9f3b-4fea-ab6a-468050ea101a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:46.093833 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7d69e162-9f3b-4fea-ab6a-468050ea101a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:46.094298 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7d69e162-9f3b-4fea-ab6a-468050ea101a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:46.095135 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7d69e162-9f3b-4fea-ab6a-468050ea101a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:46.095582 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7d69e162-9f3b-4fea-ab6a-468050ea101a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:46.188677 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1b24fc95-003f-4477-88c4-14c7d7e3852b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:46.189240 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1b24fc95-003f-4477-88c4-14c7d7e3852b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:46.196053 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1b24fc95-003f-4477-88c4-14c7d7e3852b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:46.196509 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1b24fc95-003f-4477-88c4-14c7d7e3852b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:46.197321 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1b24fc95-003f-4477-88c4-14c7d7e3852b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:46.197743 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1b24fc95-003f-4477-88c4-14c7d7e3852b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:46.564067 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-7d69e162-9f3b-4fea-ab6a-468050ea101a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:46.566973 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1b24fc95-003f-4477-88c4-14c7d7e3852b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:46.572583 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-7d69e162-9f3b-4fea-ab6a-468050ea101a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1362 microversion: 2.1 time: 0.490990 Dec 23 12:03:46.582256 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 302/638] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:46 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1362 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:46.582420 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1b24fc95-003f-4477-88c4-14c7d7e3852b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:46.582420 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1b24fc95-003f-4477-88c4-14c7d7e3852b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:46.582420 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1b24fc95-003f-4477-88c4-14c7d7e3852b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1725 microversion: 2.20 time: 0.394953 Dec 23 12:03:46.582764 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 337/639] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:03:46 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1725 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:03:47.026292 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-0c93e189-0e50-4953-95a0-5bbd328ca218 req-de86e0a2-031d-413c-bdbd-4b57174d244d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc998144-5288-467f-82de-9c1983559e40", "name": "network-vif-deleted", "tag": "bbf34ca1-ab1a-4521-9402-ff6d335fe55a"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:47.027915 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:03:47.027915 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:03:47.035144 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-0c93e189-0e50-4953-95a0-5bbd328ca218 req-de86e0a2-031d-413c-bdbd-4b57174d244d service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:47.035598 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-0c93e189-0e50-4953-95a0-5bbd328ca218 req-de86e0a2-031d-413c-bdbd-4b57174d244d service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:47.047466 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-0c93e189-0e50-4953-95a0-5bbd328ca218 req-de86e0a2-031d-413c-bdbd-4b57174d244d service nova] Creating event network-vif-deleted:bbf34ca1-ab1a-4521-9402-ff6d335fe55a for instance fc998144-5288-467f-82de-9c1983559e40 on hv-cinder-82282 Dec 23 12:03:47.052629 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-0c93e189-0e50-4953-95a0-5bbd328ca218 req-de86e0a2-031d-413c-bdbd-4b57174d244d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029972 Dec 23 12:03:47.053479 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 303/640] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:03:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:03:47.180259 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-8b9ff074-3e1e-406b-8e6b-9b472ecc31a6 req-d95e6800-d712-44ae-9696-63f7846a02bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b18df5-9ce3-44cb-8a62-730a959e46ac", "name": "network-vif-plugged", "status": "completed", "tag": "e8ea114b-8a29-4d6d-a634-848c94498c32"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:47.181851 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:03:47.181851 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:03:47.188997 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-8b9ff074-3e1e-406b-8e6b-9b472ecc31a6 req-d95e6800-d712-44ae-9696-63f7846a02bc service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:47.189645 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-8b9ff074-3e1e-406b-8e6b-9b472ecc31a6 req-d95e6800-d712-44ae-9696-63f7846a02bc service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:47.201301 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-8b9ff074-3e1e-406b-8e6b-9b472ecc31a6 req-d95e6800-d712-44ae-9696-63f7846a02bc service nova] Creating event network-vif-plugged:e8ea114b-8a29-4d6d-a634-848c94498c32 for instance f3b18df5-9ce3-44cb-8a62-730a959e46ac on hv-cinder-82282 Dec 23 12:03:47.206714 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-8b9ff074-3e1e-406b-8e6b-9b472ecc31a6 req-d95e6800-d712-44ae-9696-63f7846a02bc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030584 Dec 23 12:03:47.208946 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 338/641] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:03:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:03:47.559676 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-6251a012-6c14-4bd1-9804-2e4b7df1cba8 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:47.561137 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-6251a012-6c14-4bd1-9804-2e4b7df1cba8 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:47.567831 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6251a012-6c14-4bd1-9804-2e4b7df1cba8 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:47.568377 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6251a012-6c14-4bd1-9804-2e4b7df1cba8 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:47.569249 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6251a012-6c14-4bd1-9804-2e4b7df1cba8 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:47.569892 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6251a012-6c14-4bd1-9804-2e4b7df1cba8 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:47.589430 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-63bd8100-4ecd-49f9-aeff-4af63d56ba01 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:47.590870 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-63bd8100-4ecd-49f9-aeff-4af63d56ba01 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:47.598055 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-63bd8100-4ecd-49f9-aeff-4af63d56ba01 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:47.598807 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-63bd8100-4ecd-49f9-aeff-4af63d56ba01 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:47.599668 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-63bd8100-4ecd-49f9-aeff-4af63d56ba01 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:47.600279 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-63bd8100-4ecd-49f9-aeff-4af63d56ba01 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:47.600802 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-6251a012-6c14-4bd1-9804-2e4b7df1cba8 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Going to try to terminate instance {{(pid=116355) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:03:47.697268 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-6251a012-6c14-4bd1-9804-2e4b7df1cba8 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 204 len: 0 microversion: 2.1 time: 0.142167 Dec 23 12:03:47.699076 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 304/642] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:03:47 2021] DELETE /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:03:47.706580 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3e97982c-18a4-4981-81e3-9c492a08f320 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:47.707412 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3e97982c-18a4-4981-81e3-9c492a08f320 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:47.714316 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3e97982c-18a4-4981-81e3-9c492a08f320 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:47.714896 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3e97982c-18a4-4981-81e3-9c492a08f320 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:47.715889 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3e97982c-18a4-4981-81e3-9c492a08f320 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:47.716727 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3e97982c-18a4-4981-81e3-9c492a08f320 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:47.751640 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3e97982c-18a4-4981-81e3-9c492a08f320 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:47.752562 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3e97982c-18a4-4981-81e3-9c492a08f320 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:47.753348 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.objects.instance [None req-3e97982c-18a4-4981-81e3-9c492a08f320 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lazy-loading 'fault' on Instance uuid fc998144-5288-467f-82de-9c1983559e40 {{(pid=116355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:03:47.773595 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-63bd8100-4ecd-49f9-aeff-4af63d56ba01 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:47.785874 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-63bd8100-4ecd-49f9-aeff-4af63d56ba01 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1362 microversion: 2.1 time: 0.200253 Dec 23 12:03:47.787476 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 339/643] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:47 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:47.792020 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-02d00231-8b32-462c-bf1e-0d27d540cf6d tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:47.792646 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-02d00231-8b32-462c-bf1e-0d27d540cf6d tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:47.800777 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-02d00231-8b32-462c-bf1e-0d27d540cf6d tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:47.801476 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-02d00231-8b32-462c-bf1e-0d27d540cf6d tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:47.802805 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-02d00231-8b32-462c-bf1e-0d27d540cf6d tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:47.803405 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-02d00231-8b32-462c-bf1e-0d27d540cf6d tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:47.807483 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3e97982c-18a4-4981-81e3-9c492a08f320 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:47.816443 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3e97982c-18a4-4981-81e3-9c492a08f320 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:47.818097 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3e97982c-18a4-4981-81e3-9c492a08f320 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:47.819388 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3e97982c-18a4-4981-81e3-9c492a08f320 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 200 len: 1372 microversion: 2.20 time: 0.118940 Dec 23 12:03:47.820401 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 305/644] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:03:47 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 1372 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:03:47.960587 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-02d00231-8b32-462c-bf1e-0d27d540cf6d tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:47.968825 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-02d00231-8b32-462c-bf1e-0d27d540cf6d tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 200 len: 1513 microversion: 2.1 time: 0.180158 Dec 23 12:03:47.969854 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 340/645] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:47 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:48.803869 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0e01571e-5875-4444-bb01-17afc7f503b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:48.804497 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0e01571e-5875-4444-bb01-17afc7f503b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:48.811388 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0e01571e-5875-4444-bb01-17afc7f503b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:48.811878 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0e01571e-5875-4444-bb01-17afc7f503b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:48.812663 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0e01571e-5875-4444-bb01-17afc7f503b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:48.813104 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0e01571e-5875-4444-bb01-17afc7f503b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:48.839238 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-26cb125f-caa9-40be-b942-54c5921f0fb2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:48.839892 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-26cb125f-caa9-40be-b942-54c5921f0fb2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:48.846999 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26cb125f-caa9-40be-b942-54c5921f0fb2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:48.847455 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26cb125f-caa9-40be-b942-54c5921f0fb2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:48.848245 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26cb125f-caa9-40be-b942-54c5921f0fb2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:48.848684 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26cb125f-caa9-40be-b942-54c5921f0fb2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:48.862946 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-26cb125f-caa9-40be-b942-54c5921f0fb2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] HTTP exception thrown: Instance fc998144-5288-467f-82de-9c1983559e40 could not be found. Dec 23 12:03:48.863556 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-26cb125f-caa9-40be-b942-54c5921f0fb2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Returning 404 to user: Instance fc998144-5288-467f-82de-9c1983559e40 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:03:48.864392 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-26cb125f-caa9-40be-b942-54c5921f0fb2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 404 len: 111 microversion: 2.20 time: 0.028950 Dec 23 12:03:48.864941 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 341/646] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:03:48 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 23 12:03:48.873776 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5b1a3726-05ff-4724-90b0-d7b7e79d8b95 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '.version_select at 0x7fcf2866edc0>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:48.893909 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5b1a3726-05ff-4724-90b0-d7b7e79d8b95 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574063945" status: 204 len: 0 microversion: 2.20 time: 0.024220 Dec 23 12:03:48.894491 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 342/647] 10.222.0.65 () {60 vars in 1261 bytes} [Thu Dec 23 12:03:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574063945 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 23 12:03:48.982438 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0e01571e-5875-4444-bb01-17afc7f503b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:48.987141 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5bb627fa-0429-4889-ab67-acd3be435288 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:48.988074 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5bb627fa-0429-4889-ab67-acd3be435288 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:48.990932 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0e01571e-5875-4444-bb01-17afc7f503b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1362 microversion: 2.1 time: 0.190721 Dec 23 12:03:48.991499 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 306/648] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:48 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:48.994877 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5bb627fa-0429-4889-ab67-acd3be435288 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:48.995299 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5bb627fa-0429-4889-ab67-acd3be435288 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:48.996213 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5bb627fa-0429-4889-ab67-acd3be435288 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:48.996642 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5bb627fa-0429-4889-ab67-acd3be435288 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:49.162210 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-5bb627fa-0429-4889-ab67-acd3be435288 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:49.173294 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5bb627fa-0429-4889-ab67-acd3be435288 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 200 len: 1513 microversion: 2.1 time: 0.187552 Dec 23 12:03:49.174413 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 343/649] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:48 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:49.860760 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2c1bb5d4-ecd9-4e15-bb93-f48a12a30066 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'create', calling method: .version_select at 0x7fcf287c6700>, body: {"keypair": {"name": "tempest-keypair-792700626"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:49.876294 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-2c1bb5d4-ecd9-4e15-bb93-f48a12a30066 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Getting quotas for project e6c655658b5f4f53b4145ea20afcf1d4. Resources: {'key_pairs'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:03:49.880699 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-2c1bb5d4-ecd9-4e15-bb93-f48a12a30066 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Getting quotas for user 804530daa2704fcdb1fef91615b62c99 and project e6c655658b5f4f53b4145ea20afcf1d4. Resources: {'key_pairs'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:03:50.008025 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-cc78687c-5f3e-4c7c-945e-1e78bd53fc89 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:50.008596 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-cc78687c-5f3e-4c7c-945e-1e78bd53fc89 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:50.016444 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cc78687c-5f3e-4c7c-945e-1e78bd53fc89 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:50.016886 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cc78687c-5f3e-4c7c-945e-1e78bd53fc89 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:50.017679 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cc78687c-5f3e-4c7c-945e-1e78bd53fc89 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:50.018196 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cc78687c-5f3e-4c7c-945e-1e78bd53fc89 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:50.028369 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-2c1bb5d4-ecd9-4e15-bb93-f48a12a30066 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Getting quotas for project e6c655658b5f4f53b4145ea20afcf1d4. Resources: {'key_pairs'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:03:50.032122 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-2c1bb5d4-ecd9-4e15-bb93-f48a12a30066 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Getting quotas for user 804530daa2704fcdb1fef91615b62c99 and project e6c655658b5f4f53b4145ea20afcf1d4. Resources: {'key_pairs'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:03:50.044784 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2c1bb5d4-ecd9-4e15-bb93-f48a12a30066 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.188315 Dec 23 12:03:50.045383 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 307/650] 10.222.0.65 () {62 vars in 1198 bytes} [Thu Dec 23 12:03:49 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 190 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 23 12:03:50.155700 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-cc78687c-5f3e-4c7c-945e-1e78bd53fc89 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:50.163409 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-cc78687c-5f3e-4c7c-945e-1e78bd53fc89 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1549 microversion: 2.1 time: 0.159197 Dec 23 12:03:50.163974 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 344/651] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:50 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:50.180471 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d34c5032-ae8f-41b4-ba2b-c19aedabea9f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:50.181097 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d34c5032-ae8f-41b4-ba2b-c19aedabea9f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:50.196313 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-26f42ef6-5e51-4616-965c-74023af5e43a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:50.197147 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-26f42ef6-5e51-4616-965c-74023af5e43a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:50.199630 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d34c5032-ae8f-41b4-ba2b-c19aedabea9f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:50.200091 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d34c5032-ae8f-41b4-ba2b-c19aedabea9f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:50.200983 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d34c5032-ae8f-41b4-ba2b-c19aedabea9f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:50.201434 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d34c5032-ae8f-41b4-ba2b-c19aedabea9f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:50.205605 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26f42ef6-5e51-4616-965c-74023af5e43a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:50.206133 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26f42ef6-5e51-4616-965c-74023af5e43a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:50.207204 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26f42ef6-5e51-4616-965c-74023af5e43a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:50.207703 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26f42ef6-5e51-4616-965c-74023af5e43a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:50.339008 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d34c5032-ae8f-41b4-ba2b-c19aedabea9f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162455 Dec 23 12:03:50.340187 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 308/652] 10.222.0.65 () {58 vars in 1274 bytes} [Thu Dec 23 12:03:50 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:03:50.444211 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-26f42ef6-5e51-4616-965c-74023af5e43a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:50.451637 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-26f42ef6-5e51-4616-965c-74023af5e43a tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 200 len: 1513 microversion: 2.1 time: 0.264445 Dec 23 12:03:50.452307 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 345/653] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:50 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 1513 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:51.321426 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b2dda2f7-e3cb-4244-b63c-082ec3e86a8a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:51.322354 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b2dda2f7-e3cb-4244-b63c-082ec3e86a8a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:51.325038 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-95957449-02ce-415a-9f9d-c2ea9e4a3b8b req-675b0d3f-d993-44a2-867e-e0e616aef4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b18df5-9ce3-44cb-8a62-730a959e46ac", "tag": "e8ea114b-8a29-4d6d-a634-848c94498c32"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:51.326840 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:03:51.326840 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:03:51.337106 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b2dda2f7-e3cb-4244-b63c-082ec3e86a8a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:51.337958 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b2dda2f7-e3cb-4244-b63c-082ec3e86a8a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:51.338955 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b2dda2f7-e3cb-4244-b63c-082ec3e86a8a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:51.339544 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b2dda2f7-e3cb-4244-b63c-082ec3e86a8a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:51.339897 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-95957449-02ce-415a-9f9d-c2ea9e4a3b8b req-675b0d3f-d993-44a2-867e-e0e616aef4b4 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:51.340416 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-95957449-02ce-415a-9f9d-c2ea9e4a3b8b req-675b0d3f-d993-44a2-867e-e0e616aef4b4 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:51.355322 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-95957449-02ce-415a-9f9d-c2ea9e4a3b8b req-675b0d3f-d993-44a2-867e-e0e616aef4b4 service nova] Creating event network-changed:e8ea114b-8a29-4d6d-a634-848c94498c32 for instance f3b18df5-9ce3-44cb-8a62-730a959e46ac on hv-cinder-82282 Dec 23 12:03:51.362388 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-95957449-02ce-415a-9f9d-c2ea9e4a3b8b req-675b0d3f-d993-44a2-867e-e0e616aef4b4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046369 Dec 23 12:03:51.363475 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 346/654] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:03:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:03:51.471388 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d49c3acc-4138-413c-bc63-c2aaac2b4475 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:51.472282 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d49c3acc-4138-413c-bc63-c2aaac2b4475 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:51.479089 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b2dda2f7-e3cb-4244-b63c-082ec3e86a8a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 14 microversion: 2.1 time: 0.165349 Dec 23 12:03:51.480502 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 309/655] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:03:51 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:03:51.485392 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d49c3acc-4138-413c-bc63-c2aaac2b4475 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:51.486007 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d49c3acc-4138-413c-bc63-c2aaac2b4475 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:51.487173 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d49c3acc-4138-413c-bc63-c2aaac2b4475 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:51.487783 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d49c3acc-4138-413c-bc63-c2aaac2b4475 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:51.985293 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-d49c3acc-4138-413c-bc63-c2aaac2b4475 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:51.992768 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d49c3acc-4138-413c-bc63-c2aaac2b4475 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 200 len: 1513 microversion: 2.1 time: 0.526855 Dec 23 12:03:51.999798 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 347/656] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:51 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 1513 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:52.402095 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d441bf4a-3839-4c12-b62e-d6098c46ea09 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-89962586", "imageRef": "938a78c0-341e-4043-927a-9bfe8cf52508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ff9bb10-bc99-4d12-bacb-9778f44904da"}], "security_groups": [{"name": "tempest-securitygroup--2087673650"}], "key_name": "tempest-keypair-792700626", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:52.410132 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-89124aec-5c95-4d6c-af9e-0e89d153732c req-3c7c05cf-8620-4417-bfe8-9c83368f210c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4ca63a-c7c0-4b76-877d-bd3963a3d552", "name": "network-vif-deleted", "tag": "a7278194-1bcb-422c-b9af-18f3d0d578cc"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:52.412517 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:03:52.412517 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:03:52.423613 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-89124aec-5c95-4d6c-af9e-0e89d153732c req-3c7c05cf-8620-4417-bfe8-9c83368f210c service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:52.424482 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-89124aec-5c95-4d6c-af9e-0e89d153732c req-3c7c05cf-8620-4417-bfe8-9c83368f210c service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:52.437382 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-89124aec-5c95-4d6c-af9e-0e89d153732c req-3c7c05cf-8620-4417-bfe8-9c83368f210c service nova] Creating event network-vif-deleted:a7278194-1bcb-422c-b9af-18f3d0d578cc for instance 4e4ca63a-c7c0-4b76-877d-bd3963a3d552 on hv-cinder-82282 Dec 23 12:03:52.442925 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-89124aec-5c95-4d6c-af9e-0e89d153732c req-3c7c05cf-8620-4417-bfe8-9c83368f210c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139843 Dec 23 12:03:52.443799 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 310/657] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:03:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:03:52.491721 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2460a6bf-d528-4ffe-9224-464679d3c419 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:52.492852 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2460a6bf-d528-4ffe-9224-464679d3c419 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:52.500202 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2460a6bf-d528-4ffe-9224-464679d3c419 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:52.500739 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2460a6bf-d528-4ffe-9224-464679d3c419 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:52.501739 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2460a6bf-d528-4ffe-9224-464679d3c419 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:52.502352 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2460a6bf-d528-4ffe-9224-464679d3c419 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:52.589954 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.network.neutron [None req-d441bf4a-3839-4c12-b62e-d6098c46ea09 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] validate_networks() for [('2ff9bb10-bc99-4d12-bacb-9778f44904da', None, None, None, None, None)] {{(pid=116354) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 12:03:52.623146 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2460a6bf-d528-4ffe-9224-464679d3c419 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 14 microversion: 2.1 time: 0.135497 Dec 23 12:03:52.624006 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 311/658] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:03:52 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 23 12:03:53.011536 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-80d550e1-6368-44ef-a0bd-da6c652142b9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:53.012236 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-80d550e1-6368-44ef-a0bd-da6c652142b9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:53.020445 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-80d550e1-6368-44ef-a0bd-da6c652142b9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:53.020906 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-80d550e1-6368-44ef-a0bd-da6c652142b9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:53.021690 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-80d550e1-6368-44ef-a0bd-da6c652142b9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:53.022126 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-80d550e1-6368-44ef-a0bd-da6c652142b9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:53.031072 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-d441bf4a-3839-4c12-b62e-d6098c46ea09 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Flavor limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 12:03:53.031749 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-d441bf4a-3839-4c12-b62e-d6098c46ea09 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Image limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 12:03:53.032461 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-d441bf4a-3839-4c12-b62e-d6098c46ea09 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Flavor pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 12:03:53.032859 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-d441bf4a-3839-4c12-b62e-d6098c46ea09 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Image pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 12:03:53.033440 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-d441bf4a-3839-4c12-b62e-d6098c46ea09 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 12:03:53.042159 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d441bf4a-3839-4c12-b62e-d6098c46ea09 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:53.042842 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d441bf4a-3839-4c12-b62e-d6098c46ea09 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:53.043657 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d441bf4a-3839-4c12-b62e-d6098c46ea09 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:53.044095 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d441bf4a-3839-4c12-b62e-d6098c46ea09 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:53.058313 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-80d550e1-6368-44ef-a0bd-da6c652142b9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:53.058794 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-80d550e1-6368-44ef-a0bd-da6c652142b9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:53.059247 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.objects.instance [None req-80d550e1-6368-44ef-a0bd-da6c652142b9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lazy-loading 'fault' on Instance uuid 4e4ca63a-c7c0-4b76-877d-bd3963a3d552 {{(pid=116355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:03:53.061279 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-d441bf4a-3839-4c12-b62e-d6098c46ea09 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Getting quotas for project e6c655658b5f4f53b4145ea20afcf1d4. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:03:53.065661 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-d441bf4a-3839-4c12-b62e-d6098c46ea09 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Getting quotas for user 804530daa2704fcdb1fef91615b62c99 and project e6c655658b5f4f53b4145ea20afcf1d4. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:03:53.077041 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d441bf4a-3839-4c12-b62e-d6098c46ea09 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Going to run 1 instances... {{(pid=116354) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 12:03:53.079417 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d441bf4a-3839-4c12-b62e-d6098c46ea09 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='938a78c0-341e-4043-927a-9bfe8cf52508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 12:03:53.103744 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-80d550e1-6368-44ef-a0bd-da6c652142b9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fed87e1ecb47478db1cffa6d53f416', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656fb5fa69a64dd49ed36532dfa2ef18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:53.113209 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-80d550e1-6368-44ef-a0bd-da6c652142b9 tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 200 len: 1308 microversion: 2.1 time: 0.106366 Dec 23 12:03:53.113915 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 312/659] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:53 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:03:53.129691 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d441bf4a-3839-4c12-b62e-d6098c46ea09 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.732013 Dec 23 12:03:53.135404 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 348/660] 10.222.0.65 () {62 vars in 1187 bytes} [Thu Dec 23 12:03:52 2021] POST /compute/v2.1/servers => generated 402 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 23 12:03:53.140686 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-cebd509a-bbd6-4506-8103-f5733a0d4517 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:53.141316 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-cebd509a-bbd6-4506-8103-f5733a0d4517 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:53.197798 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-cebd509a-bbd6-4506-8103-f5733a0d4517 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:53.206743 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-cebd509a-bbd6-4506-8103-f5733a0d4517 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:53.208234 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-cebd509a-bbd6-4506-8103-f5733a0d4517 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:53.209339 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-cebd509a-bbd6-4506-8103-f5733a0d4517 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1279 microversion: 2.20 time: 0.072684 Dec 23 12:03:53.209895 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 313/661] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:03:53 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1279 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:03:53.635667 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-adabd200-9a7c-4aa6-81dd-eabbc515d06c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:53.636834 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-adabd200-9a7c-4aa6-81dd-eabbc515d06c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:53.644096 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-adabd200-9a7c-4aa6-81dd-eabbc515d06c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:53.644552 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-adabd200-9a7c-4aa6-81dd-eabbc515d06c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:53.645344 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-adabd200-9a7c-4aa6-81dd-eabbc515d06c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:53.645828 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-adabd200-9a7c-4aa6-81dd-eabbc515d06c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:53.754732 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-adabd200-9a7c-4aa6-81dd-eabbc515d06c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 14 microversion: 2.1 time: 0.123770 Dec 23 12:03:53.755376 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 349/662] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:03:53 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:03:54.134008 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f1d92d78-b552-4c8c-99b8-47a176bff84c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:54.134772 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f1d92d78-b552-4c8c-99b8-47a176bff84c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] [instance: 4e4ca63a-c7c0-4b76-877d-bd3963a3d552] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:54.144174 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f1d92d78-b552-4c8c-99b8-47a176bff84c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:54.144664 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f1d92d78-b552-4c8c-99b8-47a176bff84c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:54.145444 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f1d92d78-b552-4c8c-99b8-47a176bff84c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:54.145879 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f1d92d78-b552-4c8c-99b8-47a176bff84c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:54.159801 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-f1d92d78-b552-4c8c-99b8-47a176bff84c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] HTTP exception thrown: Instance 4e4ca63a-c7c0-4b76-877d-bd3963a3d552 could not be found. Dec 23 12:03:54.160385 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f1d92d78-b552-4c8c-99b8-47a176bff84c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] Returning 404 to user: Instance 4e4ca63a-c7c0-4b76-877d-bd3963a3d552 could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:03:54.161244 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f1d92d78-b552-4c8c-99b8-47a176bff84c tempest-VolumesSnapshotTestJSON-1210963465 tempest-VolumesSnapshotTestJSON-1210963465-project] 10.222.0.65 "GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552" status: 404 len: 111 microversion: 2.1 time: 0.033284 Dec 23 12:03:54.161771 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 314/663] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:03:54 2021] GET /compute/v2.1/servers/4e4ca63a-c7c0-4b76-877d-bd3963a3d552 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:03:54.231352 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-502b096a-2cb3-46ad-a113-823faf2a0070 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:54.232972 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-502b096a-2cb3-46ad-a113-823faf2a0070 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:54.242143 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-502b096a-2cb3-46ad-a113-823faf2a0070 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:54.242798 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-502b096a-2cb3-46ad-a113-823faf2a0070 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:54.243988 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-502b096a-2cb3-46ad-a113-823faf2a0070 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:54.244951 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-502b096a-2cb3-46ad-a113-823faf2a0070 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:54.309601 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-502b096a-2cb3-46ad-a113-823faf2a0070 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:54.323643 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-502b096a-2cb3-46ad-a113-823faf2a0070 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:54.325234 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-502b096a-2cb3-46ad-a113-823faf2a0070 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:54.327101 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-502b096a-2cb3-46ad-a113-823faf2a0070 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1331 microversion: 2.20 time: 0.102559 Dec 23 12:03:54.327761 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 350/664] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:03:54 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:03:54.765922 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-fc05ecab-f1fe-437c-9973-ae31acd13501 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:54.767162 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-fc05ecab-f1fe-437c-9973-ae31acd13501 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:54.774728 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fc05ecab-f1fe-437c-9973-ae31acd13501 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:54.775381 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fc05ecab-f1fe-437c-9973-ae31acd13501 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:54.776498 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fc05ecab-f1fe-437c-9973-ae31acd13501 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:54.776944 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fc05ecab-f1fe-437c-9973-ae31acd13501 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:54.888856 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-fc05ecab-f1fe-437c-9973-ae31acd13501 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 14 microversion: 2.1 time: 0.126321 Dec 23 12:03:54.889726 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 315/665] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:03:54 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:03:55.345174 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e210b098-45d0-4e3e-bc86-35359432c951 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:55.346382 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e210b098-45d0-4e3e-bc86-35359432c951 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:55.354333 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e210b098-45d0-4e3e-bc86-35359432c951 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:55.355004 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e210b098-45d0-4e3e-bc86-35359432c951 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:55.356327 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e210b098-45d0-4e3e-bc86-35359432c951 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:55.357884 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e210b098-45d0-4e3e-bc86-35359432c951 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:55.627885 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e210b098-45d0-4e3e-bc86-35359432c951 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:55.642403 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e210b098-45d0-4e3e-bc86-35359432c951 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:55.648609 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e210b098-45d0-4e3e-bc86-35359432c951 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:55.649744 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e210b098-45d0-4e3e-bc86-35359432c951 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1405 microversion: 2.20 time: 0.308547 Dec 23 12:03:55.650304 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 351/666] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:03:55 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1405 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:03:55.900852 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-670c5a9c-9887-4279-88bb-84abba070686 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:55.902724 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-670c5a9c-9887-4279-88bb-84abba070686 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:55.910974 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-670c5a9c-9887-4279-88bb-84abba070686 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:55.911603 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-670c5a9c-9887-4279-88bb-84abba070686 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:55.912624 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-670c5a9c-9887-4279-88bb-84abba070686 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:55.913151 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-670c5a9c-9887-4279-88bb-84abba070686 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:56.002789 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-8116cc4b-2885-493a-a05c-c9ff1f3377fe req-5f929ed7-b545-45c4-91bd-8c635b0edb7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0523247-1eca-4fec-83ea-1496d8dee549", "tag": "8c8adecf-b23d-4edb-96f6-b1d23075c761"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:56.004636 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:03:56.004636 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:03:56.019127 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-8116cc4b-2885-493a-a05c-c9ff1f3377fe req-5f929ed7-b545-45c4-91bd-8c635b0edb7f service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:56.019578 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-8116cc4b-2885-493a-a05c-c9ff1f3377fe req-5f929ed7-b545-45c4-91bd-8c635b0edb7f service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:56.031301 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-8116cc4b-2885-493a-a05c-c9ff1f3377fe req-5f929ed7-b545-45c4-91bd-8c635b0edb7f service nova] Creating event network-changed:8c8adecf-b23d-4edb-96f6-b1d23075c761 for instance b0523247-1eca-4fec-83ea-1496d8dee549 on hv-cinder-82282 Dec 23 12:03:56.036443 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-8116cc4b-2885-493a-a05c-c9ff1f3377fe req-5f929ed7-b545-45c4-91bd-8c635b0edb7f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039178 Dec 23 12:03:56.037045 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 352/667] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:03:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:03:56.676317 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ef69cb7e-5b84-494f-a76b-07669663c4f9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:56.677034 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ef69cb7e-5b84-494f-a76b-07669663c4f9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:56.686504 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ef69cb7e-5b84-494f-a76b-07669663c4f9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:56.686930 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ef69cb7e-5b84-494f-a76b-07669663c4f9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:56.687734 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ef69cb7e-5b84-494f-a76b-07669663c4f9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:56.688176 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ef69cb7e-5b84-494f-a76b-07669663c4f9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:56.832516 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ef69cb7e-5b84-494f-a76b-07669663c4f9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:56.845561 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ef69cb7e-5b84-494f-a76b-07669663c4f9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:56.848045 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ef69cb7e-5b84-494f-a76b-07669663c4f9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:56.849757 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ef69cb7e-5b84-494f-a76b-07669663c4f9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1405 microversion: 2.20 time: 0.179981 Dec 23 12:03:56.850584 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 353/668] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:03:56 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:03:57.874979 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f221736b-ec66-4ec8-b58e-72fdfc95577a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:57.875672 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f221736b-ec66-4ec8-b58e-72fdfc95577a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:57.883505 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f221736b-ec66-4ec8-b58e-72fdfc95577a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:57.884016 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f221736b-ec66-4ec8-b58e-72fdfc95577a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:57.884888 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f221736b-ec66-4ec8-b58e-72fdfc95577a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:57.885375 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f221736b-ec66-4ec8-b58e-72fdfc95577a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:58.024103 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f221736b-ec66-4ec8-b58e-72fdfc95577a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:58.032858 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f221736b-ec66-4ec8-b58e-72fdfc95577a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:58.034353 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f221736b-ec66-4ec8-b58e-72fdfc95577a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:58.035527 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f221736b-ec66-4ec8-b58e-72fdfc95577a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1405 microversion: 2.20 time: 0.166625 Dec 23 12:03:58.036087 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 354/669] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:03:57 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:03:58.950235 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-670c5a9c-9887-4279-88bb-84abba070686 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 14 microversion: 2.1 time: 3.052793 Dec 23 12:03:58.951183 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 316/670] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:03:55 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 14 bytes in 3055 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:03:59.059112 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-04ac7f63-615c-4fc5-85ce-0843eee9a786 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:03:59.059740 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-04ac7f63-615c-4fc5-85ce-0843eee9a786 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:59.066680 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-04ac7f63-615c-4fc5-85ce-0843eee9a786 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:59.067111 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-04ac7f63-615c-4fc5-85ce-0843eee9a786 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:59.067940 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-04ac7f63-615c-4fc5-85ce-0843eee9a786 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:59.068381 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-04ac7f63-615c-4fc5-85ce-0843eee9a786 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:59.311391 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-04ac7f63-615c-4fc5-85ce-0843eee9a786 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:59.322456 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-04ac7f63-615c-4fc5-85ce-0843eee9a786 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:59.324872 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-04ac7f63-615c-4fc5-85ce-0843eee9a786 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:03:59.326287 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-04ac7f63-615c-4fc5-85ce-0843eee9a786 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1405 microversion: 2.20 time: 0.270793 Dec 23 12:03:59.327148 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 355/671] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:03:59 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1405 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:03:59.963156 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-839eb3fd-31ae-4ba7-a3a1-d1134e234a8f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:03:59.964154 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-839eb3fd-31ae-4ba7-a3a1-d1134e234a8f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:03:59.971751 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-839eb3fd-31ae-4ba7-a3a1-d1134e234a8f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:59.972210 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-839eb3fd-31ae-4ba7-a3a1-d1134e234a8f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:03:59.973083 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-839eb3fd-31ae-4ba7-a3a1-d1134e234a8f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:03:59.973445 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-839eb3fd-31ae-4ba7-a3a1-d1134e234a8f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:00.080837 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-839eb3fd-31ae-4ba7-a3a1-d1134e234a8f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 14 microversion: 2.1 time: 0.121669 Dec 23 12:04:00.081468 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 317/672] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:03:59 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:04:00.348234 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-06057907-f83b-4784-b611-fefa81a2ec5c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:00.349122 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-06057907-f83b-4784-b611-fefa81a2ec5c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:00.358055 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-06057907-f83b-4784-b611-fefa81a2ec5c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:00.359491 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-06057907-f83b-4784-b611-fefa81a2ec5c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:00.360519 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-06057907-f83b-4784-b611-fefa81a2ec5c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:00.361717 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-06057907-f83b-4784-b611-fefa81a2ec5c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:00.497400 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-06057907-f83b-4784-b611-fefa81a2ec5c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:00.505644 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-06057907-f83b-4784-b611-fefa81a2ec5c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:00.507146 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-06057907-f83b-4784-b611-fefa81a2ec5c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:00.508256 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-06057907-f83b-4784-b611-fefa81a2ec5c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1405 microversion: 2.20 time: 0.165816 Dec 23 12:04:00.508794 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 356/673] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:04:00 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:04:01.095590 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a24fd0df-f818-4095-a1d3-c6a91fa48806 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:01.096599 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a24fd0df-f818-4095-a1d3-c6a91fa48806 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:01.103706 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a24fd0df-f818-4095-a1d3-c6a91fa48806 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:01.104224 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a24fd0df-f818-4095-a1d3-c6a91fa48806 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:01.104910 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a24fd0df-f818-4095-a1d3-c6a91fa48806 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:01.105339 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a24fd0df-f818-4095-a1d3-c6a91fa48806 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:01.224815 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a24fd0df-f818-4095-a1d3-c6a91fa48806 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 14 microversion: 2.1 time: 0.134716 Dec 23 12:04:01.225461 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 318/674] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:01 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:04:01.530420 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0e34bb9e-b14f-413e-aa17-6a5e691ca239 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:01.531715 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0e34bb9e-b14f-413e-aa17-6a5e691ca239 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:01.542245 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0e34bb9e-b14f-413e-aa17-6a5e691ca239 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:01.543054 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0e34bb9e-b14f-413e-aa17-6a5e691ca239 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:01.544353 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0e34bb9e-b14f-413e-aa17-6a5e691ca239 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:01.545098 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0e34bb9e-b14f-413e-aa17-6a5e691ca239 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:01.692478 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0e34bb9e-b14f-413e-aa17-6a5e691ca239 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:01.702886 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0e34bb9e-b14f-413e-aa17-6a5e691ca239 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:01.704810 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0e34bb9e-b14f-413e-aa17-6a5e691ca239 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:01.706481 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0e34bb9e-b14f-413e-aa17-6a5e691ca239 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1405 microversion: 2.20 time: 0.181894 Dec 23 12:04:01.707338 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 357/675] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:04:01 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:04:02.240526 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8193096c-d9e9-454f-a313-2b06885ba39e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:02.241765 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-8193096c-d9e9-454f-a313-2b06885ba39e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:02.252457 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8193096c-d9e9-454f-a313-2b06885ba39e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:02.253214 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8193096c-d9e9-454f-a313-2b06885ba39e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:02.254460 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8193096c-d9e9-454f-a313-2b06885ba39e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:02.255240 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8193096c-d9e9-454f-a313-2b06885ba39e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:02.381010 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-8193096c-d9e9-454f-a313-2b06885ba39e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 14 microversion: 2.1 time: 0.145416 Dec 23 12:04:02.381663 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 319/676] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:02 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:04:02.726809 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e2efb954-fa05-4855-83d1-2e8551071b4d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:02.727403 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e2efb954-fa05-4855-83d1-2e8551071b4d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:02.736616 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2efb954-fa05-4855-83d1-2e8551071b4d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:02.737069 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2efb954-fa05-4855-83d1-2e8551071b4d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:02.737848 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2efb954-fa05-4855-83d1-2e8551071b4d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:02.738282 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2efb954-fa05-4855-83d1-2e8551071b4d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:02.884434 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e2efb954-fa05-4855-83d1-2e8551071b4d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:02.893052 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e2efb954-fa05-4855-83d1-2e8551071b4d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:02.894550 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e2efb954-fa05-4855-83d1-2e8551071b4d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:02.895654 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e2efb954-fa05-4855-83d1-2e8551071b4d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1405 microversion: 2.20 time: 0.174425 Dec 23 12:04:02.896186 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 358/677] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:04:02 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:04:03.392941 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0546364e-d1e2-493d-b1bb-466447ead670 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:03.393945 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0546364e-d1e2-493d-b1bb-466447ead670 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:03.401447 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0546364e-d1e2-493d-b1bb-466447ead670 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:03.401910 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0546364e-d1e2-493d-b1bb-466447ead670 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:03.402720 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0546364e-d1e2-493d-b1bb-466447ead670 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:03.403155 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0546364e-d1e2-493d-b1bb-466447ead670 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:03.508079 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0546364e-d1e2-493d-b1bb-466447ead670 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 14 microversion: 2.1 time: 0.118653 Dec 23 12:04:03.509053 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 320/678] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:03 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:04:03.917087 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-6e2b5738-4281-4390-9658-a35b93c8f7eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:03.917936 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-6e2b5738-4281-4390-9658-a35b93c8f7eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:03.927695 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6e2b5738-4281-4390-9658-a35b93c8f7eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:03.928383 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6e2b5738-4281-4390-9658-a35b93c8f7eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:03.929565 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6e2b5738-4281-4390-9658-a35b93c8f7eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:03.930225 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6e2b5738-4281-4390-9658-a35b93c8f7eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:04.063374 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-6e2b5738-4281-4390-9658-a35b93c8f7eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:04.071556 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-6e2b5738-4281-4390-9658-a35b93c8f7eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:04.073039 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-6e2b5738-4281-4390-9658-a35b93c8f7eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:04.074195 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-6e2b5738-4281-4390-9658-a35b93c8f7eb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1405 microversion: 2.20 time: 0.162819 Dec 23 12:04:04.075649 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 359/679] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:04:03 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:04:04.525993 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-cc0b47b9-0670-4685-a9e1-589742e3f6cf tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:04.527722 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-cc0b47b9-0670-4685-a9e1-589742e3f6cf tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:04.539372 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cc0b47b9-0670-4685-a9e1-589742e3f6cf tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:04.540119 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cc0b47b9-0670-4685-a9e1-589742e3f6cf tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:04.541389 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cc0b47b9-0670-4685-a9e1-589742e3f6cf tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:04.542065 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cc0b47b9-0670-4685-a9e1-589742e3f6cf tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:05.095923 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-73ba4322-2296-478b-a94a-92313874e70b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:05.096737 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-73ba4322-2296-478b-a94a-92313874e70b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:05.107118 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-73ba4322-2296-478b-a94a-92313874e70b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:05.107821 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-73ba4322-2296-478b-a94a-92313874e70b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:05.109428 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-73ba4322-2296-478b-a94a-92313874e70b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:05.110034 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-73ba4322-2296-478b-a94a-92313874e70b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:05.251977 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-73ba4322-2296-478b-a94a-92313874e70b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:05.259967 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-73ba4322-2296-478b-a94a-92313874e70b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:05.261525 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-73ba4322-2296-478b-a94a-92313874e70b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:05.262656 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-73ba4322-2296-478b-a94a-92313874e70b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1405 microversion: 2.20 time: 0.173122 Dec 23 12:04:05.263230 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 360/680] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:04:05 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:04:06.283796 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1dab760d-6069-4e8f-a484-661adf72bb4c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:06.284539 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1dab760d-6069-4e8f-a484-661adf72bb4c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:06.292522 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1dab760d-6069-4e8f-a484-661adf72bb4c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:06.293068 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1dab760d-6069-4e8f-a484-661adf72bb4c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:06.294002 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1dab760d-6069-4e8f-a484-661adf72bb4c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:06.294566 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1dab760d-6069-4e8f-a484-661adf72bb4c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:06.435865 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1dab760d-6069-4e8f-a484-661adf72bb4c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:06.444688 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1dab760d-6069-4e8f-a484-661adf72bb4c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:06.446172 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1dab760d-6069-4e8f-a484-661adf72bb4c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:06.447307 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1dab760d-6069-4e8f-a484-661adf72bb4c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1405 microversion: 2.20 time: 0.168838 Dec 23 12:04:06.447888 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 361/681] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:04:06 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:04:07.194553 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-cc0b47b9-0670-4685-a9e1-589742e3f6cf tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 18208 microversion: 2.1 time: 2.675174 Dec 23 12:04:07.195226 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 321/682] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:04 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 18208 bytes in 2677 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:07.465710 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-26857859-7c21-4028-b94e-e6cafd45dbed tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:07.466247 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-26857859-7c21-4028-b94e-e6cafd45dbed tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:07.473224 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26857859-7c21-4028-b94e-e6cafd45dbed tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:07.473671 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26857859-7c21-4028-b94e-e6cafd45dbed tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:07.474445 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26857859-7c21-4028-b94e-e6cafd45dbed tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:07.474905 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-26857859-7c21-4028-b94e-e6cafd45dbed tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:07.624648 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-26857859-7c21-4028-b94e-e6cafd45dbed tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:07.633607 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-26857859-7c21-4028-b94e-e6cafd45dbed tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:07.635172 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-26857859-7c21-4028-b94e-e6cafd45dbed tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:07.636281 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-26857859-7c21-4028-b94e-e6cafd45dbed tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1405 microversion: 2.20 time: 0.174476 Dec 23 12:04:07.636815 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 362/683] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:04:07 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:04:08.206546 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d80d603b-7d83-4a03-84c5-73a46ef78e1b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:08.207450 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d80d603b-7d83-4a03-84c5-73a46ef78e1b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:08.215945 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d80d603b-7d83-4a03-84c5-73a46ef78e1b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:08.216394 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d80d603b-7d83-4a03-84c5-73a46ef78e1b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:08.217185 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d80d603b-7d83-4a03-84c5-73a46ef78e1b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:08.217618 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d80d603b-7d83-4a03-84c5-73a46ef78e1b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:08.350467 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d80d603b-7d83-4a03-84c5-73a46ef78e1b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 19342 microversion: 2.1 time: 0.144639 Dec 23 12:04:08.351461 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 322/684] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:08 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 19342 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:08.653587 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f7fb42b2-395b-4f64-8e9a-8033678bbf3e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:08.654143 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f7fb42b2-395b-4f64-8e9a-8033678bbf3e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:08.661364 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f7fb42b2-395b-4f64-8e9a-8033678bbf3e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:08.661808 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f7fb42b2-395b-4f64-8e9a-8033678bbf3e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:08.662607 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f7fb42b2-395b-4f64-8e9a-8033678bbf3e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:08.663043 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f7fb42b2-395b-4f64-8e9a-8033678bbf3e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:08.795624 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f7fb42b2-395b-4f64-8e9a-8033678bbf3e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:08.804302 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f7fb42b2-395b-4f64-8e9a-8033678bbf3e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:08.805793 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f7fb42b2-395b-4f64-8e9a-8033678bbf3e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:08.806937 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f7fb42b2-395b-4f64-8e9a-8033678bbf3e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1405 microversion: 2.20 time: 0.157086 Dec 23 12:04:08.807506 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 363/685] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:04:08 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:04:09.362845 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-61179086-77ec-4d32-b9bb-f8bf392b249f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:09.363792 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-61179086-77ec-4d32-b9bb-f8bf392b249f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:09.369629 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-61179086-77ec-4d32-b9bb-f8bf392b249f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:09.376042 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-61179086-77ec-4d32-b9bb-f8bf392b249f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:09.377627 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-61179086-77ec-4d32-b9bb-f8bf392b249f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:09.378387 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-61179086-77ec-4d32-b9bb-f8bf392b249f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:09.407996 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-4a92ed5d-91ab-4ddf-88dd-9ba404860716 req-1a1d989f-7efb-46b8-ac62-e66d8a210023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0523247-1eca-4fec-83ea-1496d8dee549", "name": "network-vif-plugged", "status": "completed", "tag": "8c8adecf-b23d-4edb-96f6-b1d23075c761"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:09.409742 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:04:09.409742 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:04:09.418147 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-4a92ed5d-91ab-4ddf-88dd-9ba404860716 req-1a1d989f-7efb-46b8-ac62-e66d8a210023 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:09.418620 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-4a92ed5d-91ab-4ddf-88dd-9ba404860716 req-1a1d989f-7efb-46b8-ac62-e66d8a210023 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:09.428850 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-4a92ed5d-91ab-4ddf-88dd-9ba404860716 req-1a1d989f-7efb-46b8-ac62-e66d8a210023 service nova] Creating event network-vif-plugged:8c8adecf-b23d-4edb-96f6-b1d23075c761 for instance b0523247-1eca-4fec-83ea-1496d8dee549 on hv-cinder-82282 Dec 23 12:04:09.433659 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-4a92ed5d-91ab-4ddf-88dd-9ba404860716 req-1a1d989f-7efb-46b8-ac62-e66d8a210023 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109639 Dec 23 12:04:09.434249 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 323/686] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:04:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:04:09.534846 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-61179086-77ec-4d32-b9bb-f8bf392b249f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 21945 microversion: 2.1 time: 0.180452 Dec 23 12:04:09.535615 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 364/687] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:09 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 21945 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:09.826756 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b056efba-bed0-458a-9fb5-234f0750f5ba tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:09.827443 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b056efba-bed0-458a-9fb5-234f0750f5ba tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:09.836472 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b056efba-bed0-458a-9fb5-234f0750f5ba tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:09.836930 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b056efba-bed0-458a-9fb5-234f0750f5ba tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:09.837742 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b056efba-bed0-458a-9fb5-234f0750f5ba tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:09.838184 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b056efba-bed0-458a-9fb5-234f0750f5ba tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:10.020209 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b056efba-bed0-458a-9fb5-234f0750f5ba tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:10.037728 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b056efba-bed0-458a-9fb5-234f0750f5ba tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:10.039262 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b056efba-bed0-458a-9fb5-234f0750f5ba tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:10.040407 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b056efba-bed0-458a-9fb5-234f0750f5ba tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1405 microversion: 2.20 time: 0.218357 Dec 23 12:04:10.041037 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 324/688] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:04:09 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:04:10.551851 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c2ad2df7-1c0e-487c-870c-d3096444a8b7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:10.553395 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c2ad2df7-1c0e-487c-870c-d3096444a8b7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:10.571658 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c2ad2df7-1c0e-487c-870c-d3096444a8b7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:10.572111 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c2ad2df7-1c0e-487c-870c-d3096444a8b7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:10.572939 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c2ad2df7-1c0e-487c-870c-d3096444a8b7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:10.573355 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c2ad2df7-1c0e-487c-870c-d3096444a8b7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:10.707843 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c2ad2df7-1c0e-487c-870c-d3096444a8b7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 23219 microversion: 2.1 time: 0.163270 Dec 23 12:04:10.709129 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 365/689] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:10 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 23219 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:11.059726 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a4af16ae-2f48-41b4-88e9-29d19e63eb74 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:11.060336 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a4af16ae-2f48-41b4-88e9-29d19e63eb74 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:11.067180 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a4af16ae-2f48-41b4-88e9-29d19e63eb74 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:11.067633 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a4af16ae-2f48-41b4-88e9-29d19e63eb74 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:11.068406 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a4af16ae-2f48-41b4-88e9-29d19e63eb74 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:11.068846 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a4af16ae-2f48-41b4-88e9-29d19e63eb74 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:11.205890 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a4af16ae-2f48-41b4-88e9-29d19e63eb74 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:11.214554 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a4af16ae-2f48-41b4-88e9-29d19e63eb74 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:11.216030 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a4af16ae-2f48-41b4-88e9-29d19e63eb74 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:11.217130 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a4af16ae-2f48-41b4-88e9-29d19e63eb74 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1405 microversion: 2.20 time: 0.161206 Dec 23 12:04:11.217687 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 325/690] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:04:11 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:04:11.720399 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f26beaad-3547-49b8-87c2-cce250a83a7b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:11.721310 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f26beaad-3547-49b8-87c2-cce250a83a7b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:11.728603 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f26beaad-3547-49b8-87c2-cce250a83a7b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:11.729092 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f26beaad-3547-49b8-87c2-cce250a83a7b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:11.729897 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f26beaad-3547-49b8-87c2-cce250a83a7b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:11.730331 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f26beaad-3547-49b8-87c2-cce250a83a7b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:11.859457 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f26beaad-3547-49b8-87c2-cce250a83a7b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 23882 microversion: 2.1 time: 0.142797 Dec 23 12:04:11.863886 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 366/691] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:11 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 23882 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:12.238118 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-fee5c34f-4582-4370-be93-dcc92dc76675 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:12.238760 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-fee5c34f-4582-4370-be93-dcc92dc76675 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:12.245204 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fee5c34f-4582-4370-be93-dcc92dc76675 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:12.245650 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fee5c34f-4582-4370-be93-dcc92dc76675 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:12.246419 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fee5c34f-4582-4370-be93-dcc92dc76675 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:12.246915 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fee5c34f-4582-4370-be93-dcc92dc76675 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:12.637900 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-fee5c34f-4582-4370-be93-dcc92dc76675 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:12.645816 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-fee5c34f-4582-4370-be93-dcc92dc76675 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:12.647357 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-fee5c34f-4582-4370-be93-dcc92dc76675 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:12.648503 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-fee5c34f-4582-4370-be93-dcc92dc76675 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1597 microversion: 2.20 time: 0.414468 Dec 23 12:04:12.649028 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 326/692] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:04:12 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1597 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:04:12.666046 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d8738d9b-8cf0-4b49-8f2f-9236a86f1ae6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:12.666682 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d8738d9b-8cf0-4b49-8f2f-9236a86f1ae6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:12.674021 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d8738d9b-8cf0-4b49-8f2f-9236a86f1ae6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:12.674482 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d8738d9b-8cf0-4b49-8f2f-9236a86f1ae6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:12.675291 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d8738d9b-8cf0-4b49-8f2f-9236a86f1ae6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:12.675733 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d8738d9b-8cf0-4b49-8f2f-9236a86f1ae6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:12.758500 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d8738d9b-8cf0-4b49-8f2f-9236a86f1ae6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096273 Dec 23 12:04:12.759217 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 367/693] 10.222.0.65 () {60 vars in 1315 bytes} [Thu Dec 23 12:04:12 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:12.874123 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e99323ae-240b-448b-99fd-be939d13bd46 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:12.875594 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e99323ae-240b-448b-99fd-be939d13bd46 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:12.882188 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e99323ae-240b-448b-99fd-be939d13bd46 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:12.882681 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e99323ae-240b-448b-99fd-be939d13bd46 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:12.883623 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e99323ae-240b-448b-99fd-be939d13bd46 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:12.884103 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e99323ae-240b-448b-99fd-be939d13bd46 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:13.011216 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e99323ae-240b-448b-99fd-be939d13bd46 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 25318 microversion: 2.1 time: 0.142186 Dec 23 12:04:13.011878 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 327/694] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:12 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 25318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:13.746278 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-91a5fc6d-b001-46b9-a225-d49419cb1d10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:13.747257 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-91a5fc6d-b001-46b9-a225-d49419cb1d10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:13.748542 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-2963b6eb-e44e-4453-b026-fed6b356b8fa req-fdd43270-4cbd-466e-9559-cec2e2cfe6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0523247-1eca-4fec-83ea-1496d8dee549", "tag": "8c8adecf-b23d-4edb-96f6-b1d23075c761"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:13.750142 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:04:13.750142 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:04:13.755141 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-91a5fc6d-b001-46b9-a225-d49419cb1d10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:13.755599 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-91a5fc6d-b001-46b9-a225-d49419cb1d10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:13.756415 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-91a5fc6d-b001-46b9-a225-d49419cb1d10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:13.756855 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-91a5fc6d-b001-46b9-a225-d49419cb1d10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:13.759354 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-2963b6eb-e44e-4453-b026-fed6b356b8fa req-fdd43270-4cbd-466e-9559-cec2e2cfe6f6 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:13.760057 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-2963b6eb-e44e-4453-b026-fed6b356b8fa req-fdd43270-4cbd-466e-9559-cec2e2cfe6f6 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:13.773887 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-2963b6eb-e44e-4453-b026-fed6b356b8fa req-fdd43270-4cbd-466e-9559-cec2e2cfe6f6 service nova] Creating event network-changed:8c8adecf-b23d-4edb-96f6-b1d23075c761 for instance b0523247-1eca-4fec-83ea-1496d8dee549 on hv-cinder-82282 Dec 23 12:04:13.779131 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-2963b6eb-e44e-4453-b026-fed6b356b8fa req-fdd43270-4cbd-466e-9559-cec2e2cfe6f6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034629 Dec 23 12:04:13.780040 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 328/695] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:04:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 12:04:13.892379 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-91a5fc6d-b001-46b9-a225-d49419cb1d10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 14 microversion: 2.20 time: 0.150013 Dec 23 12:04:13.892957 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 368/696] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:13 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:14.023774 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ab8480f9-38a4-4128-b58d-e7c1095ae16e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:14.025046 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ab8480f9-38a4-4128-b58d-e7c1095ae16e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:14.033557 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ab8480f9-38a4-4128-b58d-e7c1095ae16e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:14.034206 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ab8480f9-38a4-4128-b58d-e7c1095ae16e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:14.035173 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ab8480f9-38a4-4128-b58d-e7c1095ae16e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:14.035906 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ab8480f9-38a4-4128-b58d-e7c1095ae16e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:14.178996 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ab8480f9-38a4-4128-b58d-e7c1095ae16e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 26368 microversion: 2.1 time: 0.158826 Dec 23 12:04:14.180179 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 329/697] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:14 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 26368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:14.904495 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a8a828a7-80cb-4daa-9a9f-e2c71c5919a8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:14.905608 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a8a828a7-80cb-4daa-9a9f-e2c71c5919a8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:14.913002 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a8a828a7-80cb-4daa-9a9f-e2c71c5919a8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:14.913450 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a8a828a7-80cb-4daa-9a9f-e2c71c5919a8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:14.914195 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a8a828a7-80cb-4daa-9a9f-e2c71c5919a8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:14.914879 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a8a828a7-80cb-4daa-9a9f-e2c71c5919a8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:15.023798 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a8a828a7-80cb-4daa-9a9f-e2c71c5919a8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 14 microversion: 2.20 time: 0.123250 Dec 23 12:04:15.024533 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 369/698] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:14 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:15.191407 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-02a4d4b5-aeb2-4ded-9e82-d6091c74fd25 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:15.193341 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-02a4d4b5-aeb2-4ded-9e82-d6091c74fd25 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:15.200566 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-02a4d4b5-aeb2-4ded-9e82-d6091c74fd25 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:15.200998 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-02a4d4b5-aeb2-4ded-9e82-d6091c74fd25 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:15.201807 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-02a4d4b5-aeb2-4ded-9e82-d6091c74fd25 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:15.202278 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-02a4d4b5-aeb2-4ded-9e82-d6091c74fd25 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:15.326777 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-02a4d4b5-aeb2-4ded-9e82-d6091c74fd25 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 27135 microversion: 2.1 time: 0.139389 Dec 23 12:04:15.331226 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 330/699] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:15 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 27135 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:16.039760 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b020f0ea-3019-49f8-b169-9902b9f9af3a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:16.041000 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b020f0ea-3019-49f8-b169-9902b9f9af3a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:16.050143 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b020f0ea-3019-49f8-b169-9902b9f9af3a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:16.050791 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b020f0ea-3019-49f8-b169-9902b9f9af3a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:16.051766 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b020f0ea-3019-49f8-b169-9902b9f9af3a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:16.052366 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b020f0ea-3019-49f8-b169-9902b9f9af3a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:16.162115 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b020f0ea-3019-49f8-b169-9902b9f9af3a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 14 microversion: 2.20 time: 0.127645 Dec 23 12:04:16.162952 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 370/700] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:16 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:16.339831 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f8f6e62d-6a99-419f-b3db-59d3ceb987b0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:16.340846 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f8f6e62d-6a99-419f-b3db-59d3ceb987b0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:16.348240 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f8f6e62d-6a99-419f-b3db-59d3ceb987b0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:16.348702 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f8f6e62d-6a99-419f-b3db-59d3ceb987b0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:16.349489 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f8f6e62d-6a99-419f-b3db-59d3ceb987b0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:16.349927 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f8f6e62d-6a99-419f-b3db-59d3ceb987b0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:16.471772 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f8f6e62d-6a99-419f-b3db-59d3ceb987b0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 27594 microversion: 2.1 time: 0.135971 Dec 23 12:04:16.476321 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 331/701] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:16 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 27594 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:17.178719 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-17ad7e7b-9c46-47f2-a80e-cf6fbcbcffe1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:17.180326 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-17ad7e7b-9c46-47f2-a80e-cf6fbcbcffe1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:17.191180 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-17ad7e7b-9c46-47f2-a80e-cf6fbcbcffe1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:17.191935 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-17ad7e7b-9c46-47f2-a80e-cf6fbcbcffe1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:17.193064 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-17ad7e7b-9c46-47f2-a80e-cf6fbcbcffe1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:17.193830 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-17ad7e7b-9c46-47f2-a80e-cf6fbcbcffe1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:17.294325 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-17ad7e7b-9c46-47f2-a80e-cf6fbcbcffe1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 14 microversion: 2.20 time: 0.121542 Dec 23 12:04:17.295384 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 371/702] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:17 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:17.489463 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d3d399af-b3e7-434c-bbd9-bb99041f82af tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:17.491148 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d3d399af-b3e7-434c-bbd9-bb99041f82af tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:17.502818 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d3d399af-b3e7-434c-bbd9-bb99041f82af tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:17.503588 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d3d399af-b3e7-434c-bbd9-bb99041f82af tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:17.504883 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d3d399af-b3e7-434c-bbd9-bb99041f82af tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:17.505621 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d3d399af-b3e7-434c-bbd9-bb99041f82af tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:17.621841 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d3d399af-b3e7-434c-bbd9-bb99041f82af tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 27902 microversion: 2.1 time: 0.139535 Dec 23 12:04:17.622616 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 332/703] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:17 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 27902 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:18.309242 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-388013ae-8462-4458-80c7-9e8a32ee3f77 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:18.310254 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-388013ae-8462-4458-80c7-9e8a32ee3f77 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:18.319739 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-388013ae-8462-4458-80c7-9e8a32ee3f77 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:18.320249 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-388013ae-8462-4458-80c7-9e8a32ee3f77 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:18.321317 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-388013ae-8462-4458-80c7-9e8a32ee3f77 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:18.321778 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-388013ae-8462-4458-80c7-9e8a32ee3f77 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:18.433183 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-388013ae-8462-4458-80c7-9e8a32ee3f77 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 14 microversion: 2.20 time: 0.128439 Dec 23 12:04:18.433838 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 372/704] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:18 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:04:18.635033 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3f2bcb5a-d859-4d79-9997-3c314f259a98 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:18.636303 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3f2bcb5a-d859-4d79-9997-3c314f259a98 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:18.644073 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3f2bcb5a-d859-4d79-9997-3c314f259a98 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:18.644548 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3f2bcb5a-d859-4d79-9997-3c314f259a98 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:18.645357 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3f2bcb5a-d859-4d79-9997-3c314f259a98 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:18.645804 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3f2bcb5a-d859-4d79-9997-3c314f259a98 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:18.770050 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3f2bcb5a-d859-4d79-9997-3c314f259a98 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 28200 microversion: 2.1 time: 0.138639 Dec 23 12:04:18.771088 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 333/705] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:18 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 28200 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:19.447837 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-fb623e36-a2e5-4070-9c5f-b5d3b4cdfe95 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:19.449266 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-fb623e36-a2e5-4070-9c5f-b5d3b4cdfe95 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:19.459827 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fb623e36-a2e5-4070-9c5f-b5d3b4cdfe95 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:19.460141 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fb623e36-a2e5-4070-9c5f-b5d3b4cdfe95 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:19.461297 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fb623e36-a2e5-4070-9c5f-b5d3b4cdfe95 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:19.461960 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fb623e36-a2e5-4070-9c5f-b5d3b4cdfe95 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:19.567431 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-fb623e36-a2e5-4070-9c5f-b5d3b4cdfe95 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 14 microversion: 2.20 time: 0.125196 Dec 23 12:04:19.568399 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 373/706] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:19 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:19.789294 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-6b06def7-8e91-42d9-a1d3-c855cead7e92 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:19.791042 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-6b06def7-8e91-42d9-a1d3-c855cead7e92 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:19.802675 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6b06def7-8e91-42d9-a1d3-c855cead7e92 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:19.803508 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6b06def7-8e91-42d9-a1d3-c855cead7e92 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:19.804327 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6b06def7-8e91-42d9-a1d3-c855cead7e92 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:19.804772 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6b06def7-8e91-42d9-a1d3-c855cead7e92 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:19.914541 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-6b06def7-8e91-42d9-a1d3-c855cead7e92 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 28200 microversion: 2.1 time: 0.131585 Dec 23 12:04:19.915579 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 334/707] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:19 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 28200 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:20.586804 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e3477a99-2c8e-47d9-96c1-c1a7690793c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:20.587816 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e3477a99-2c8e-47d9-96c1-c1a7690793c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:20.595656 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e3477a99-2c8e-47d9-96c1-c1a7690793c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:20.596115 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e3477a99-2c8e-47d9-96c1-c1a7690793c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:20.596904 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e3477a99-2c8e-47d9-96c1-c1a7690793c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:20.597345 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e3477a99-2c8e-47d9-96c1-c1a7690793c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:20.699667 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e3477a99-2c8e-47d9-96c1-c1a7690793c9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 14 microversion: 2.20 time: 0.121469 Dec 23 12:04:20.700846 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 374/708] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:20 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:20.934395 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-79c1d044-46fb-42a6-81ed-c28bf3ff4884 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:20.936078 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-79c1d044-46fb-42a6-81ed-c28bf3ff4884 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:20.946355 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-79c1d044-46fb-42a6-81ed-c28bf3ff4884 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:20.946845 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-79c1d044-46fb-42a6-81ed-c28bf3ff4884 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:20.947630 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-79c1d044-46fb-42a6-81ed-c28bf3ff4884 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:20.948066 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-79c1d044-46fb-42a6-81ed-c28bf3ff4884 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:21.080279 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-79c1d044-46fb-42a6-81ed-c28bf3ff4884 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 28491 microversion: 2.1 time: 0.153080 Dec 23 12:04:21.081337 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 335/709] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:20 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 28491 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:21.717724 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7f219d19-42b8-4240-8d2d-f1997baec155 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:21.719259 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-7f219d19-42b8-4240-8d2d-f1997baec155 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:21.728701 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7f219d19-42b8-4240-8d2d-f1997baec155 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:21.729157 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7f219d19-42b8-4240-8d2d-f1997baec155 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:21.729934 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7f219d19-42b8-4240-8d2d-f1997baec155 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:21.730374 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7f219d19-42b8-4240-8d2d-f1997baec155 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:21.843738 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-7f219d19-42b8-4240-8d2d-f1997baec155 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 14 microversion: 2.20 time: 0.132705 Dec 23 12:04:21.844600 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 375/710] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:21 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:22.099460 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f172ae4b-bde1-4643-bc52-8240f9ad6363 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:22.101116 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f172ae4b-bde1-4643-bc52-8240f9ad6363 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:22.113668 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f172ae4b-bde1-4643-bc52-8240f9ad6363 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:22.114430 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f172ae4b-bde1-4643-bc52-8240f9ad6363 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:22.115763 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f172ae4b-bde1-4643-bc52-8240f9ad6363 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:22.116493 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f172ae4b-bde1-4643-bc52-8240f9ad6363 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:22.248792 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f172ae4b-bde1-4643-bc52-8240f9ad6363 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 28659 microversion: 2.1 time: 0.155997 Dec 23 12:04:22.249434 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 336/711] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:22 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 28659 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:22.862218 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ae39debe-006d-4995-a6bd-ff6da36a271b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:22.863888 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ae39debe-006d-4995-a6bd-ff6da36a271b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:22.872585 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ae39debe-006d-4995-a6bd-ff6da36a271b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:22.873030 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ae39debe-006d-4995-a6bd-ff6da36a271b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:22.873825 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ae39debe-006d-4995-a6bd-ff6da36a271b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:22.874229 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ae39debe-006d-4995-a6bd-ff6da36a271b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:23.001749 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ae39debe-006d-4995-a6bd-ff6da36a271b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 14 microversion: 2.20 time: 0.146602 Dec 23 12:04:23.002294 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 376/712] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:22 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:23.264817 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5f467f2b-5431-4ac7-aeb5-8517a2129339 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:23.266347 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5f467f2b-5431-4ac7-aeb5-8517a2129339 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:23.276572 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5f467f2b-5431-4ac7-aeb5-8517a2129339 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:23.277179 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5f467f2b-5431-4ac7-aeb5-8517a2129339 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:23.278268 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5f467f2b-5431-4ac7-aeb5-8517a2129339 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:23.278897 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5f467f2b-5431-4ac7-aeb5-8517a2129339 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:23.390156 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5f467f2b-5431-4ac7-aeb5-8517a2129339 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 28659 microversion: 2.1 time: 0.131503 Dec 23 12:04:23.390882 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 337/713] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:23 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 28659 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:24.013743 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-bcf0e21c-7b74-46d0-a41c-afc7dea2cfdd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:24.014802 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-bcf0e21c-7b74-46d0-a41c-afc7dea2cfdd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:24.022086 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-bcf0e21c-7b74-46d0-a41c-afc7dea2cfdd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:24.022569 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-bcf0e21c-7b74-46d0-a41c-afc7dea2cfdd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:24.023369 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-bcf0e21c-7b74-46d0-a41c-afc7dea2cfdd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:24.023877 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-bcf0e21c-7b74-46d0-a41c-afc7dea2cfdd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:24.134731 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-bcf0e21c-7b74-46d0-a41c-afc7dea2cfdd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 14 microversion: 2.20 time: 0.124911 Dec 23 12:04:24.135490 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 377/714] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:24 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:24.402535 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d9e19165-bd26-45bc-8c07-7b7122a8cbdb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:24.403555 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d9e19165-bd26-45bc-8c07-7b7122a8cbdb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:24.410530 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d9e19165-bd26-45bc-8c07-7b7122a8cbdb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:24.411003 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d9e19165-bd26-45bc-8c07-7b7122a8cbdb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:24.411789 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d9e19165-bd26-45bc-8c07-7b7122a8cbdb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:24.412235 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d9e19165-bd26-45bc-8c07-7b7122a8cbdb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:24.523085 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d9e19165-bd26-45bc-8c07-7b7122a8cbdb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 28659 microversion: 2.1 time: 0.124110 Dec 23 12:04:24.524197 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 338/715] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:24 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 28659 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:25.149203 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0ad31197-526c-406c-95d9-33b547eacaf0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:25.150303 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0ad31197-526c-406c-95d9-33b547eacaf0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:25.157543 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0ad31197-526c-406c-95d9-33b547eacaf0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:25.158000 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0ad31197-526c-406c-95d9-33b547eacaf0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:25.158818 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0ad31197-526c-406c-95d9-33b547eacaf0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:25.159236 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0ad31197-526c-406c-95d9-33b547eacaf0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:25.298960 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0ad31197-526c-406c-95d9-33b547eacaf0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 14 microversion: 2.20 time: 0.155049 Dec 23 12:04:25.299819 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 378/716] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:25 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:25.541479 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d43dee2c-9df8-4944-872e-75ae646dc561 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:25.542816 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d43dee2c-9df8-4944-872e-75ae646dc561 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:25.551720 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d43dee2c-9df8-4944-872e-75ae646dc561 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:25.552256 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d43dee2c-9df8-4944-872e-75ae646dc561 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:25.553228 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d43dee2c-9df8-4944-872e-75ae646dc561 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:25.553777 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d43dee2c-9df8-4944-872e-75ae646dc561 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:25.662934 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d43dee2c-9df8-4944-872e-75ae646dc561 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 28659 microversion: 2.1 time: 0.127267 Dec 23 12:04:25.663691 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 339/717] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:25 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 28659 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:26.316894 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-803eece8-fd00-42ed-bdb5-021e01c2b59d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:26.318574 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-803eece8-fd00-42ed-bdb5-021e01c2b59d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:26.326700 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-803eece8-fd00-42ed-bdb5-021e01c2b59d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:26.327155 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-803eece8-fd00-42ed-bdb5-021e01c2b59d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:26.327937 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-803eece8-fd00-42ed-bdb5-021e01c2b59d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:26.328367 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-803eece8-fd00-42ed-bdb5-021e01c2b59d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:26.457962 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-803eece8-fd00-42ed-bdb5-021e01c2b59d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 1799 microversion: 2.20 time: 0.147388 Dec 23 12:04:26.459008 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 379/718] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:26 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 1799 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:04:26.676379 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-de23731f-17ba-4235-bf95-bf83f24e18d9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:26.677378 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-de23731f-17ba-4235-bf95-bf83f24e18d9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:26.684784 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-de23731f-17ba-4235-bf95-bf83f24e18d9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:26.685246 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-de23731f-17ba-4235-bf95-bf83f24e18d9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:26.686027 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-de23731f-17ba-4235-bf95-bf83f24e18d9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:26.686464 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-de23731f-17ba-4235-bf95-bf83f24e18d9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:26.813767 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-de23731f-17ba-4235-bf95-bf83f24e18d9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 29185 microversion: 2.1 time: 0.141165 Dec 23 12:04:26.814727 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 340/719] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:26 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 29185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:27.476669 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f8cacace-92e2-45d1-ac02-1d80bacd43b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:27.478457 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f8cacace-92e2-45d1-ac02-1d80bacd43b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:27.490490 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f8cacace-92e2-45d1-ac02-1d80bacd43b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:27.491275 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f8cacace-92e2-45d1-ac02-1d80bacd43b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:27.492680 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f8cacace-92e2-45d1-ac02-1d80bacd43b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:27.493139 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f8cacace-92e2-45d1-ac02-1d80bacd43b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:27.600858 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f8cacace-92e2-45d1-ac02-1d80bacd43b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 11817 microversion: 2.20 time: 0.130754 Dec 23 12:04:27.601910 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 380/720] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:27 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 11817 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:27.828300 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-05e19b5b-b34e-42a3-9b53-a9e26c1e13aa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:27.829344 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-05e19b5b-b34e-42a3-9b53-a9e26c1e13aa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:27.836675 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-05e19b5b-b34e-42a3-9b53-a9e26c1e13aa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:27.837125 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-05e19b5b-b34e-42a3-9b53-a9e26c1e13aa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:27.837914 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-05e19b5b-b34e-42a3-9b53-a9e26c1e13aa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:27.838349 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-05e19b5b-b34e-42a3-9b53-a9e26c1e13aa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:27.955673 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-05e19b5b-b34e-42a3-9b53-a9e26c1e13aa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 30650 microversion: 2.1 time: 0.130841 Dec 23 12:04:27.956684 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 341/721] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:27 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 30650 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:28.618614 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-148afb6d-fe00-4fe6-a8e6-137da0aee85c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:28.620120 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-148afb6d-fe00-4fe6-a8e6-137da0aee85c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:28.631934 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-148afb6d-fe00-4fe6-a8e6-137da0aee85c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:28.632703 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-148afb6d-fe00-4fe6-a8e6-137da0aee85c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:28.633734 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-148afb6d-fe00-4fe6-a8e6-137da0aee85c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:28.634179 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-148afb6d-fe00-4fe6-a8e6-137da0aee85c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:28.773071 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-148afb6d-fe00-4fe6-a8e6-137da0aee85c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 17861 microversion: 2.20 time: 0.161460 Dec 23 12:04:28.773961 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 381/722] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:28 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 17861 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 23 12:04:28.974239 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-aa38e437-dfdb-4d90-9b13-b451e8fa3a0f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:28.975762 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-aa38e437-dfdb-4d90-9b13-b451e8fa3a0f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:28.987707 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aa38e437-dfdb-4d90-9b13-b451e8fa3a0f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:28.988452 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aa38e437-dfdb-4d90-9b13-b451e8fa3a0f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:28.989733 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aa38e437-dfdb-4d90-9b13-b451e8fa3a0f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:28.990447 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aa38e437-dfdb-4d90-9b13-b451e8fa3a0f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:29.114741 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-aa38e437-dfdb-4d90-9b13-b451e8fa3a0f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 32080 microversion: 2.1 time: 0.146666 Dec 23 12:04:29.115825 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 342/723] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:28 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 32080 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:29.791571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c224ca49-9902-4251-bd7f-b300a388f5b9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:29.793285 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c224ca49-9902-4251-bd7f-b300a388f5b9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:29.804719 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c224ca49-9902-4251-bd7f-b300a388f5b9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:29.805536 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c224ca49-9902-4251-bd7f-b300a388f5b9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:29.806320 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c224ca49-9902-4251-bd7f-b300a388f5b9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:29.806787 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c224ca49-9902-4251-bd7f-b300a388f5b9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:29.950192 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c224ca49-9902-4251-bd7f-b300a388f5b9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 18013 microversion: 2.20 time: 0.165159 Dec 23 12:04:29.951290 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 382/724] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:29 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 18013 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:30.133903 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e0cf6f59-fa45-4290-a774-841beed82321 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:30.134863 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e0cf6f59-fa45-4290-a774-841beed82321 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:30.142121 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e0cf6f59-fa45-4290-a774-841beed82321 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:30.142589 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e0cf6f59-fa45-4290-a774-841beed82321 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:30.143405 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e0cf6f59-fa45-4290-a774-841beed82321 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:30.143855 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e0cf6f59-fa45-4290-a774-841beed82321 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:30.281134 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e0cf6f59-fa45-4290-a774-841beed82321 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 33057 microversion: 2.1 time: 0.153610 Dec 23 12:04:30.282137 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 343/725] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:30 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 33057 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:30.967479 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5185e5ec-297d-4633-91e5-86908c6989ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:30.968554 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5185e5ec-297d-4633-91e5-86908c6989ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:30.977536 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5185e5ec-297d-4633-91e5-86908c6989ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:30.978068 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5185e5ec-297d-4633-91e5-86908c6989ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:30.979012 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5185e5ec-297d-4633-91e5-86908c6989ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:30.979522 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5185e5ec-297d-4633-91e5-86908c6989ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:31.098958 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5185e5ec-297d-4633-91e5-86908c6989ae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 19775 microversion: 2.20 time: 0.136225 Dec 23 12:04:31.099944 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 383/726] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:30 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 19775 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:31.300716 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4b8bbe95-7552-46ab-bcad-1e1cb8f27fde tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:31.302416 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4b8bbe95-7552-46ab-bcad-1e1cb8f27fde tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:31.311220 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4b8bbe95-7552-46ab-bcad-1e1cb8f27fde tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:31.311682 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4b8bbe95-7552-46ab-bcad-1e1cb8f27fde tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:31.312470 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4b8bbe95-7552-46ab-bcad-1e1cb8f27fde tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:31.312908 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4b8bbe95-7552-46ab-bcad-1e1cb8f27fde tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:31.419767 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4b8bbe95-7552-46ab-bcad-1e1cb8f27fde tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 33714 microversion: 2.1 time: 0.125875 Dec 23 12:04:31.420428 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 344/727] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:31 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 33714 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:32.118592 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b43d9e6d-e361-428e-839e-2b9208121afa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:32.120265 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b43d9e6d-e361-428e-839e-2b9208121afa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:32.132032 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b43d9e6d-e361-428e-839e-2b9208121afa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:32.132806 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b43d9e6d-e361-428e-839e-2b9208121afa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:32.134188 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b43d9e6d-e361-428e-839e-2b9208121afa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:32.134763 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b43d9e6d-e361-428e-839e-2b9208121afa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:32.258419 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b43d9e6d-e361-428e-839e-2b9208121afa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 22211 microversion: 2.20 time: 0.146336 Dec 23 12:04:32.259540 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 384/728] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:32 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 22211 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:32.436256 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-7a787104-5dce-4d5b-9bad-46890ef956c1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:32.437802 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-7a787104-5dce-4d5b-9bad-46890ef956c1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:32.448421 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7a787104-5dce-4d5b-9bad-46890ef956c1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:32.448867 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7a787104-5dce-4d5b-9bad-46890ef956c1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:32.450139 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7a787104-5dce-4d5b-9bad-46890ef956c1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:32.450895 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7a787104-5dce-4d5b-9bad-46890ef956c1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:32.577532 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-7a787104-5dce-4d5b-9bad-46890ef956c1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 34534 microversion: 2.1 time: 0.147818 Dec 23 12:04:32.578670 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 345/729] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:32 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 34534 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:33.273947 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-237fd911-adeb-4356-93bc-b3c874d9b305 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:33.275166 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-237fd911-adeb-4356-93bc-b3c874d9b305 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:33.282493 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-237fd911-adeb-4356-93bc-b3c874d9b305 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:33.283011 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-237fd911-adeb-4356-93bc-b3c874d9b305 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:33.283786 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-237fd911-adeb-4356-93bc-b3c874d9b305 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:33.284209 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-237fd911-adeb-4356-93bc-b3c874d9b305 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:33.396027 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-237fd911-adeb-4356-93bc-b3c874d9b305 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 23772 microversion: 2.20 time: 0.127422 Dec 23 12:04:33.396674 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 385/730] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:33 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 23772 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:33.597267 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-63ea804c-d5c0-41e2-8c10-f8565218c6df tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:33.599014 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-63ea804c-d5c0-41e2-8c10-f8565218c6df tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:33.607872 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-63ea804c-d5c0-41e2-8c10-f8565218c6df tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:33.608332 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-63ea804c-d5c0-41e2-8c10-f8565218c6df tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:33.609475 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-63ea804c-d5c0-41e2-8c10-f8565218c6df tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:33.609914 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-63ea804c-d5c0-41e2-8c10-f8565218c6df tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:33.730807 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-63ea804c-d5c0-41e2-8c10-f8565218c6df tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 35385 microversion: 2.1 time: 0.140470 Dec 23 12:04:33.731490 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 346/731] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:33 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 35385 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:34.409070 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-03f8dfbf-c617-454e-8748-ef84453be640 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:34.410089 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-03f8dfbf-c617-454e-8748-ef84453be640 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:34.417559 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-03f8dfbf-c617-454e-8748-ef84453be640 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:34.417991 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-03f8dfbf-c617-454e-8748-ef84453be640 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:34.418831 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-03f8dfbf-c617-454e-8748-ef84453be640 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:34.419271 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-03f8dfbf-c617-454e-8748-ef84453be640 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:34.541541 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-03f8dfbf-c617-454e-8748-ef84453be640 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 24728 microversion: 2.20 time: 0.136277 Dec 23 12:04:34.542326 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 386/732] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:34 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 24728 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:34.745444 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-7ac5acff-9b43-4fbf-8a0a-3a116747c6a0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:34.746641 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-7ac5acff-9b43-4fbf-8a0a-3a116747c6a0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:34.754739 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7ac5acff-9b43-4fbf-8a0a-3a116747c6a0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:34.755268 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7ac5acff-9b43-4fbf-8a0a-3a116747c6a0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:34.756164 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7ac5acff-9b43-4fbf-8a0a-3a116747c6a0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:34.756671 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7ac5acff-9b43-4fbf-8a0a-3a116747c6a0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:34.892685 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-7ac5acff-9b43-4fbf-8a0a-3a116747c6a0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 36505 microversion: 2.1 time: 0.151291 Dec 23 12:04:34.893788 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 347/733] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:34 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 36505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:35.558275 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5da62f60-bd02-4603-aaa6-672ba8d91645 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:35.559321 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5da62f60-bd02-4603-aaa6-672ba8d91645 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:35.566556 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5da62f60-bd02-4603-aaa6-672ba8d91645 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:35.567023 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5da62f60-bd02-4603-aaa6-672ba8d91645 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:35.567812 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5da62f60-bd02-4603-aaa6-672ba8d91645 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:35.568244 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5da62f60-bd02-4603-aaa6-672ba8d91645 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:35.685422 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5da62f60-bd02-4603-aaa6-672ba8d91645 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 25932 microversion: 2.20 time: 0.132430 Dec 23 12:04:35.686460 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 387/734] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:35 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 25932 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:35.912537 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3331d802-f95b-4b8d-8bb5-1daff4f96011 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:35.914056 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3331d802-f95b-4b8d-8bb5-1daff4f96011 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:35.921887 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3331d802-f95b-4b8d-8bb5-1daff4f96011 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:35.922342 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3331d802-f95b-4b8d-8bb5-1daff4f96011 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:35.923164 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3331d802-f95b-4b8d-8bb5-1daff4f96011 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:35.923605 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3331d802-f95b-4b8d-8bb5-1daff4f96011 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:36.040628 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3331d802-f95b-4b8d-8bb5-1daff4f96011 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 37645 microversion: 2.1 time: 0.134271 Dec 23 12:04:36.041303 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 348/735] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:35 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 37645 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:36.703652 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-655348e0-5ea8-4844-9107-1c377ec13ce1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:36.707410 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-655348e0-5ea8-4844-9107-1c377ec13ce1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:36.716270 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-655348e0-5ea8-4844-9107-1c377ec13ce1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:36.716831 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-655348e0-5ea8-4844-9107-1c377ec13ce1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:36.717808 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-655348e0-5ea8-4844-9107-1c377ec13ce1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:36.718379 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-655348e0-5ea8-4844-9107-1c377ec13ce1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:36.848237 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-655348e0-5ea8-4844-9107-1c377ec13ce1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 26937 microversion: 2.20 time: 0.149567 Dec 23 12:04:36.849228 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 388/736] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:36 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 26937 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:37.057031 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ad41475c-d3b0-4979-aa88-1cc1c6c830ea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:37.058474 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ad41475c-d3b0-4979-aa88-1cc1c6c830ea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:37.066319 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ad41475c-d3b0-4979-aa88-1cc1c6c830ea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:37.066829 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ad41475c-d3b0-4979-aa88-1cc1c6c830ea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:37.067656 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ad41475c-d3b0-4979-aa88-1cc1c6c830ea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:37.068123 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ad41475c-d3b0-4979-aa88-1cc1c6c830ea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:37.198543 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ad41475c-d3b0-4979-aa88-1cc1c6c830ea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 38175 microversion: 2.1 time: 0.148103 Dec 23 12:04:37.199421 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 349/737] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:37 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 38175 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:37.867139 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-91541e0f-5e12-410b-9f70-9971a570cb88 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:37.868841 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-91541e0f-5e12-410b-9f70-9971a570cb88 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:37.878077 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-91541e0f-5e12-410b-9f70-9971a570cb88 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:37.878710 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-91541e0f-5e12-410b-9f70-9971a570cb88 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:37.880115 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-91541e0f-5e12-410b-9f70-9971a570cb88 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:37.880924 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-91541e0f-5e12-410b-9f70-9971a570cb88 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:38.008065 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-91541e0f-5e12-410b-9f70-9971a570cb88 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 27568 microversion: 2.20 time: 0.147710 Dec 23 12:04:38.008709 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 389/738] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:37 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 27568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:38.216243 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4def459d-e5e3-4a0b-b52f-d2366f4b2347 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:38.217824 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4def459d-e5e3-4a0b-b52f-d2366f4b2347 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:38.229283 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4def459d-e5e3-4a0b-b52f-d2366f4b2347 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:38.230234 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4def459d-e5e3-4a0b-b52f-d2366f4b2347 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:38.231056 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4def459d-e5e3-4a0b-b52f-d2366f4b2347 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:38.231490 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4def459d-e5e3-4a0b-b52f-d2366f4b2347 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:38.343215 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4def459d-e5e3-4a0b-b52f-d2366f4b2347 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 38175 microversion: 2.1 time: 0.133669 Dec 23 12:04:38.344268 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 350/739] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:38 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 38175 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:39.025454 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-14648322-55ac-41eb-87a1-ee5b4553faa8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:39.027162 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-14648322-55ac-41eb-87a1-ee5b4553faa8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:39.039208 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-14648322-55ac-41eb-87a1-ee5b4553faa8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:39.039948 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-14648322-55ac-41eb-87a1-ee5b4553faa8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:39.041235 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-14648322-55ac-41eb-87a1-ee5b4553faa8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:39.041986 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-14648322-55ac-41eb-87a1-ee5b4553faa8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:39.151133 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-14648322-55ac-41eb-87a1-ee5b4553faa8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 27971 microversion: 2.20 time: 0.131982 Dec 23 12:04:39.152138 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 390/740] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:39 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 27971 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:39.362147 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0b64b3bd-23f0-4e51-92d4-a2d6685a760b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:39.363759 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0b64b3bd-23f0-4e51-92d4-a2d6685a760b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:39.373583 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0b64b3bd-23f0-4e51-92d4-a2d6685a760b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:39.374032 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0b64b3bd-23f0-4e51-92d4-a2d6685a760b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:39.374883 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0b64b3bd-23f0-4e51-92d4-a2d6685a760b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:39.375318 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0b64b3bd-23f0-4e51-92d4-a2d6685a760b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:39.491824 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0b64b3bd-23f0-4e51-92d4-a2d6685a760b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 38175 microversion: 2.1 time: 0.136182 Dec 23 12:04:39.492966 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 351/741] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:39 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 38175 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:40.168066 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3f3c3372-e761-4f4f-bb30-20287f6485b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:40.169680 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3f3c3372-e761-4f4f-bb30-20287f6485b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:40.181112 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3f3c3372-e761-4f4f-bb30-20287f6485b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:40.181851 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3f3c3372-e761-4f4f-bb30-20287f6485b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:40.183192 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3f3c3372-e761-4f4f-bb30-20287f6485b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:40.184541 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3f3c3372-e761-4f4f-bb30-20287f6485b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:40.297442 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3f3c3372-e761-4f4f-bb30-20287f6485b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 28215 microversion: 2.20 time: 0.135793 Dec 23 12:04:40.298332 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 391/742] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:40 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 28215 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:40.510346 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b1695db0-5ce2-4fcc-83ce-618281c84096 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:40.512025 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b1695db0-5ce2-4fcc-83ce-618281c84096 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:40.519426 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b1695db0-5ce2-4fcc-83ce-618281c84096 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:40.519874 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b1695db0-5ce2-4fcc-83ce-618281c84096 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:40.520674 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b1695db0-5ce2-4fcc-83ce-618281c84096 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:40.521109 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b1695db0-5ce2-4fcc-83ce-618281c84096 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:40.644843 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b1695db0-5ce2-4fcc-83ce-618281c84096 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 200 len: 38304 microversion: 2.1 time: 0.140679 Dec 23 12:04:40.645845 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 352/743] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:40 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 38304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:04:40.660336 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-64769afd-69bb-4ac3-92ba-6b41fec72ea1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:40.660901 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-64769afd-69bb-4ac3-92ba-6b41fec72ea1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:40.668000 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-64769afd-69bb-4ac3-92ba-6b41fec72ea1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:40.668824 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-64769afd-69bb-4ac3-92ba-6b41fec72ea1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:40.669221 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-64769afd-69bb-4ac3-92ba-6b41fec72ea1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:40.669691 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-64769afd-69bb-4ac3-92ba-6b41fec72ea1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:40.694731 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-64769afd-69bb-4ac3-92ba-6b41fec72ea1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/ips" status: 200 len: 146 microversion: 2.1 time: 0.038667 Dec 23 12:04:40.695506 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 392/744] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Dec 23 12:04:40 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:04:41.314541 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0de8cb04-f5c7-46c1-9458-79e94b448c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:41.315760 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0de8cb04-f5c7-46c1-9458-79e94b448c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:41.324469 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0de8cb04-f5c7-46c1-9458-79e94b448c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:41.325008 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0de8cb04-f5c7-46c1-9458-79e94b448c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:41.326417 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0de8cb04-f5c7-46c1-9458-79e94b448c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:41.326981 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0de8cb04-f5c7-46c1-9458-79e94b448c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:41.447044 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0de8cb04-f5c7-46c1-9458-79e94b448c03 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 28215 microversion: 2.20 time: 0.137287 Dec 23 12:04:41.448225 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 353/745] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:41 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 28215 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:42.460379 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4c8d1f1d-a234-491c-b1e6-0fbd18d8a467 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:42.461445 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4c8d1f1d-a234-491c-b1e6-0fbd18d8a467 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:42.468421 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4c8d1f1d-a234-491c-b1e6-0fbd18d8a467 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:42.468878 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4c8d1f1d-a234-491c-b1e6-0fbd18d8a467 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:42.469665 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4c8d1f1d-a234-491c-b1e6-0fbd18d8a467 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:42.470104 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4c8d1f1d-a234-491c-b1e6-0fbd18d8a467 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:42.585134 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4c8d1f1d-a234-491c-b1e6-0fbd18d8a467 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 28506 microversion: 2.20 time: 0.128370 Dec 23 12:04:42.585772 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 393/746] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:42 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 28506 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:43.034299 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-42f23571-89cb-46ab-88c6-e65e099bec6a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b0f217a-da1a-410d-a029-be99437cd314"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:43.035486 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-42f23571-89cb-46ab-88c6-e65e099bec6a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:43.042704 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-42f23571-89cb-46ab-88c6-e65e099bec6a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:43.043164 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-42f23571-89cb-46ab-88c6-e65e099bec6a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:43.043951 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-42f23571-89cb-46ab-88c6-e65e099bec6a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:43.044394 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-42f23571-89cb-46ab-88c6-e65e099bec6a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:43.319415 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-42f23571-89cb-46ab-88c6-e65e099bec6a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289241 Dec 23 12:04:43.320048 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 354/747] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Dec 23 12:04:43 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:04:43.599742 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5bbf8f31-9415-4fda-9357-338762c72cec tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:43.600999 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5bbf8f31-9415-4fda-9357-338762c72cec tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:43.610894 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5bbf8f31-9415-4fda-9357-338762c72cec tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:43.611354 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5bbf8f31-9415-4fda-9357-338762c72cec tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:43.612149 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5bbf8f31-9415-4fda-9357-338762c72cec tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:43.612589 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5bbf8f31-9415-4fda-9357-338762c72cec tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:43.726412 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5bbf8f31-9415-4fda-9357-338762c72cec tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 28674 microversion: 2.20 time: 0.132369 Dec 23 12:04:43.727090 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 394/748] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:43 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 28674 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:44.742544 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-708d3ccb-3318-42c8-b269-40123a47b987 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:44.743832 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-708d3ccb-3318-42c8-b269-40123a47b987 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:44.752433 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-708d3ccb-3318-42c8-b269-40123a47b987 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:44.752883 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-708d3ccb-3318-42c8-b269-40123a47b987 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:44.753667 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-708d3ccb-3318-42c8-b269-40123a47b987 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:44.754100 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-708d3ccb-3318-42c8-b269-40123a47b987 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:44.862466 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-708d3ccb-3318-42c8-b269-40123a47b987 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 28674 microversion: 2.20 time: 0.126873 Dec 23 12:04:44.863274 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 355/749] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:44 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 28674 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:45.881991 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8a1f8332-f9ec-4cc6-adbb-470dcf5c7415 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:45.883701 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8a1f8332-f9ec-4cc6-adbb-470dcf5c7415 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:45.893227 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8a1f8332-f9ec-4cc6-adbb-470dcf5c7415 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:45.893681 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8a1f8332-f9ec-4cc6-adbb-470dcf5c7415 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:45.894464 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8a1f8332-f9ec-4cc6-adbb-470dcf5c7415 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:45.894929 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8a1f8332-f9ec-4cc6-adbb-470dcf5c7415 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:46.006079 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8a1f8332-f9ec-4cc6-adbb-470dcf5c7415 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 28674 microversion: 2.20 time: 0.130525 Dec 23 12:04:46.006956 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 395/750] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:45 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 28674 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:47.022365 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c5a0797c-0748-410e-b01e-d246bbee9c33 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:47.023591 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c5a0797c-0748-410e-b01e-d246bbee9c33 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:47.032353 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c5a0797c-0748-410e-b01e-d246bbee9c33 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:47.032814 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c5a0797c-0748-410e-b01e-d246bbee9c33 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:47.033604 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c5a0797c-0748-410e-b01e-d246bbee9c33 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:47.034046 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c5a0797c-0748-410e-b01e-d246bbee9c33 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:47.171860 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c5a0797c-0748-410e-b01e-d246bbee9c33 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 28674 microversion: 2.20 time: 0.154601 Dec 23 12:04:47.172544 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 356/751] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:47 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 28674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:48.189115 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-70600824-9ec9-476f-a735-27f45dbfd743 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:48.190772 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-70600824-9ec9-476f-a735-27f45dbfd743 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:48.202351 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-70600824-9ec9-476f-a735-27f45dbfd743 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:48.202751 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-70600824-9ec9-476f-a735-27f45dbfd743 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:48.203538 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-70600824-9ec9-476f-a735-27f45dbfd743 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:48.204010 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-70600824-9ec9-476f-a735-27f45dbfd743 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:48.332827 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-70600824-9ec9-476f-a735-27f45dbfd743 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 28722 microversion: 2.20 time: 0.150072 Dec 23 12:04:48.333866 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 396/752] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:48 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 28722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:49.352473 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4c5ea53b-1781-4ed7-aaf7-b31211f92948 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:49.354066 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4c5ea53b-1781-4ed7-aaf7-b31211f92948 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:49.365699 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4c5ea53b-1781-4ed7-aaf7-b31211f92948 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:49.366451 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4c5ea53b-1781-4ed7-aaf7-b31211f92948 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:49.367813 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4c5ea53b-1781-4ed7-aaf7-b31211f92948 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:49.368493 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4c5ea53b-1781-4ed7-aaf7-b31211f92948 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:49.504517 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4c5ea53b-1781-4ed7-aaf7-b31211f92948 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 30571 microversion: 2.20 time: 0.158372 Dec 23 12:04:49.505516 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 357/753] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:49 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 30571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:50.519862 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-13cf75bb-578c-4472-891d-5922f7436268 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:50.520875 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-13cf75bb-578c-4472-891d-5922f7436268 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:50.528099 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-13cf75bb-578c-4472-891d-5922f7436268 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:50.528555 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-13cf75bb-578c-4472-891d-5922f7436268 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:50.529340 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-13cf75bb-578c-4472-891d-5922f7436268 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:50.529779 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-13cf75bb-578c-4472-891d-5922f7436268 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:50.647155 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-13cf75bb-578c-4472-891d-5922f7436268 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 31956 microversion: 2.20 time: 0.130696 Dec 23 12:04:50.647978 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 397/754] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:50 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 31956 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:50.861014 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-bb63e3d6-5086-4a13-a0f8-e24672d34bbf tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:50.871255 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bb63e3d6-5086-4a13-a0f8-e24672d34bbf tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:50.871877 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bb63e3d6-5086-4a13-a0f8-e24672d34bbf tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:50.934008 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-bb63e3d6-5086-4a13-a0f8-e24672d34bbf tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Going to try to stop instance {{(pid=116355) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 23 12:04:50.982174 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-bb63e3d6-5086-4a13-a0f8-e24672d34bbf tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 202 len: 0 microversion: 2.1 time: 0.127911 Dec 23 12:04:50.982812 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 358/755] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:04:50 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:50.992078 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-21864cd3-67f6-4f6d-a6b1-83c0bb92d6cd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:50.992799 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-21864cd3-67f6-4f6d-a6b1-83c0bb92d6cd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:51.000052 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-21864cd3-67f6-4f6d-a6b1-83c0bb92d6cd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:51.000536 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-21864cd3-67f6-4f6d-a6b1-83c0bb92d6cd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:51.001325 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-21864cd3-67f6-4f6d-a6b1-83c0bb92d6cd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:51.001759 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-21864cd3-67f6-4f6d-a6b1-83c0bb92d6cd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:51.151701 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-21864cd3-67f6-4f6d-a6b1-83c0bb92d6cd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:51.160454 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-21864cd3-67f6-4f6d-a6b1-83c0bb92d6cd tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1723 microversion: 2.1 time: 0.172648 Dec 23 12:04:51.161029 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 398/756] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:04:50 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:04:51.665250 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e6989b65-fc31-4509-8a53-230d95447acf tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:51.666833 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e6989b65-fc31-4509-8a53-230d95447acf tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:51.677831 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6989b65-fc31-4509-8a53-230d95447acf tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:51.678611 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6989b65-fc31-4509-8a53-230d95447acf tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:51.679935 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6989b65-fc31-4509-8a53-230d95447acf tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:51.680683 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e6989b65-fc31-4509-8a53-230d95447acf tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:51.810119 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e6989b65-fc31-4509-8a53-230d95447acf tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 33178 microversion: 2.20 time: 0.151925 Dec 23 12:04:51.811182 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 359/757] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:51 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 33178 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:52.181587 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8a96622a-da5f-44f2-940a-b01db1055afa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:52.182711 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8a96622a-da5f-44f2-940a-b01db1055afa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:52.193454 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8a96622a-da5f-44f2-940a-b01db1055afa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:52.194223 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8a96622a-da5f-44f2-940a-b01db1055afa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:52.195574 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8a96622a-da5f-44f2-940a-b01db1055afa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:52.196303 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8a96622a-da5f-44f2-940a-b01db1055afa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:52.344513 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8a96622a-da5f-44f2-940a-b01db1055afa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:52.352817 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8a96622a-da5f-44f2-940a-b01db1055afa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1723 microversion: 2.1 time: 0.177394 Dec 23 12:04:52.353603 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 399/758] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:04:52 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:52.828116 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-72230d03-1170-4b72-9d1b-7843affb1eae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:52.829171 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-72230d03-1170-4b72-9d1b-7843affb1eae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:52.837898 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-72230d03-1170-4b72-9d1b-7843affb1eae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:52.838346 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-72230d03-1170-4b72-9d1b-7843affb1eae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:52.839146 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-72230d03-1170-4b72-9d1b-7843affb1eae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:52.839583 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-72230d03-1170-4b72-9d1b-7843affb1eae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:52.965642 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-72230d03-1170-4b72-9d1b-7843affb1eae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 33813 microversion: 2.20 time: 0.143960 Dec 23 12:04:52.966678 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 360/759] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:52 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 33813 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:53.375058 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f97e1c97-68ab-45ac-9f1b-f9fdf4119929 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:53.376205 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f97e1c97-68ab-45ac-9f1b-f9fdf4119929 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:53.386229 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f97e1c97-68ab-45ac-9f1b-f9fdf4119929 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:53.386812 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f97e1c97-68ab-45ac-9f1b-f9fdf4119929 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:53.388052 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f97e1c97-68ab-45ac-9f1b-f9fdf4119929 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:53.388724 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f97e1c97-68ab-45ac-9f1b-f9fdf4119929 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:53.521256 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f97e1c97-68ab-45ac-9f1b-f9fdf4119929 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:53.534038 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f97e1c97-68ab-45ac-9f1b-f9fdf4119929 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1723 microversion: 2.1 time: 0.164412 Dec 23 12:04:53.534870 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 400/760] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:04:53 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:53.985792 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c02bd6fb-8f2d-4de7-91f7-389ed772e3d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:53.987479 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c02bd6fb-8f2d-4de7-91f7-389ed772e3d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:53.998953 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c02bd6fb-8f2d-4de7-91f7-389ed772e3d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:53.999818 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c02bd6fb-8f2d-4de7-91f7-389ed772e3d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:54.000610 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c02bd6fb-8f2d-4de7-91f7-389ed772e3d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:54.001046 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c02bd6fb-8f2d-4de7-91f7-389ed772e3d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:54.126650 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c02bd6fb-8f2d-4de7-91f7-389ed772e3d1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 34773 microversion: 2.20 time: 0.148724 Dec 23 12:04:54.127281 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 361/761] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:53 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 34773 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:54.555670 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f7497b06-60b3-4152-827a-396a6963ae88 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:54.556716 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f7497b06-60b3-4152-827a-396a6963ae88 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:54.565623 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f7497b06-60b3-4152-827a-396a6963ae88 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:54.566081 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f7497b06-60b3-4152-827a-396a6963ae88 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:54.566890 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f7497b06-60b3-4152-827a-396a6963ae88 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:54.567321 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f7497b06-60b3-4152-827a-396a6963ae88 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:54.713463 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f7497b06-60b3-4152-827a-396a6963ae88 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:54.722063 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f7497b06-60b3-4152-827a-396a6963ae88 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1723 microversion: 2.1 time: 0.172569 Dec 23 12:04:54.723291 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 401/762] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:04:54 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:55.142599 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-99b76f56-af95-40d8-9457-f3c7f9828c2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:55.143617 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-99b76f56-af95-40d8-9457-f3c7f9828c2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:55.150827 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-99b76f56-af95-40d8-9457-f3c7f9828c2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:55.151316 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-99b76f56-af95-40d8-9457-f3c7f9828c2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:55.152100 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-99b76f56-af95-40d8-9457-f3c7f9828c2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:55.152537 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-99b76f56-af95-40d8-9457-f3c7f9828c2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:55.286074 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-99b76f56-af95-40d8-9457-f3c7f9828c2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 35569 microversion: 2.20 time: 0.148800 Dec 23 12:04:55.287138 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 362/763] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:55 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 35569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:55.748713 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-292323d6-ee54-4b35-bfa4-b5635136491e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:55.749335 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-292323d6-ee54-4b35-bfa4-b5635136491e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:55.758874 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-292323d6-ee54-4b35-bfa4-b5635136491e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:55.759506 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-292323d6-ee54-4b35-bfa4-b5635136491e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:55.760544 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-292323d6-ee54-4b35-bfa4-b5635136491e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:55.761101 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-292323d6-ee54-4b35-bfa4-b5635136491e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:55.903033 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-292323d6-ee54-4b35-bfa4-b5635136491e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:55.911476 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-292323d6-ee54-4b35-bfa4-b5635136491e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1723 microversion: 2.1 time: 0.168810 Dec 23 12:04:55.912057 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 402/764] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:04:55 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:56.303887 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0878812d-6670-4367-ac10-ca333db0e509 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:56.305139 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0878812d-6670-4367-ac10-ca333db0e509 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:56.314129 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0878812d-6670-4367-ac10-ca333db0e509 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:56.314745 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0878812d-6670-4367-ac10-ca333db0e509 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:56.315727 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0878812d-6670-4367-ac10-ca333db0e509 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:56.316276 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0878812d-6670-4367-ac10-ca333db0e509 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:56.434547 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0878812d-6670-4367-ac10-ca333db0e509 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 36933 microversion: 2.20 time: 0.135345 Dec 23 12:04:56.435577 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 363/765] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:56 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 36933 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:56.932750 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c96559bc-57ae-4df6-a044-53b05bb05b97 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:56.933749 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c96559bc-57ae-4df6-a044-53b05bb05b97 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:56.942272 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c96559bc-57ae-4df6-a044-53b05bb05b97 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:56.942765 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c96559bc-57ae-4df6-a044-53b05bb05b97 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:56.943547 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c96559bc-57ae-4df6-a044-53b05bb05b97 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:56.943981 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c96559bc-57ae-4df6-a044-53b05bb05b97 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:57.086018 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c96559bc-57ae-4df6-a044-53b05bb05b97 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:57.097714 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c96559bc-57ae-4df6-a044-53b05bb05b97 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1723 microversion: 2.1 time: 0.170853 Dec 23 12:04:57.098540 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 403/766] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:04:56 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:57.454127 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b63f1e8d-1825-40af-b0c7-5e2f66c42a22 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:57.455879 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b63f1e8d-1825-40af-b0c7-5e2f66c42a22 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:57.467475 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b63f1e8d-1825-40af-b0c7-5e2f66c42a22 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:57.468237 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b63f1e8d-1825-40af-b0c7-5e2f66c42a22 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:57.469761 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b63f1e8d-1825-40af-b0c7-5e2f66c42a22 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:57.470254 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b63f1e8d-1825-40af-b0c7-5e2f66c42a22 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:57.584262 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b63f1e8d-1825-40af-b0c7-5e2f66c42a22 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 38216 microversion: 2.20 time: 0.136549 Dec 23 12:04:57.585278 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 364/767] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:57 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 38216 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:58.123587 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-395e86db-e400-4ad3-977a-2d1ec9e1d04c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:58.124569 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-395e86db-e400-4ad3-977a-2d1ec9e1d04c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:58.135419 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-395e86db-e400-4ad3-977a-2d1ec9e1d04c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:58.136203 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-395e86db-e400-4ad3-977a-2d1ec9e1d04c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:58.137502 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-395e86db-e400-4ad3-977a-2d1ec9e1d04c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:58.138237 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-395e86db-e400-4ad3-977a-2d1ec9e1d04c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:58.292555 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-395e86db-e400-4ad3-977a-2d1ec9e1d04c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:58.305293 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-395e86db-e400-4ad3-977a-2d1ec9e1d04c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1723 microversion: 2.1 time: 0.187774 Dec 23 12:04:58.305978 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 404/768] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:04:58 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:58.603948 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-67b2275a-9564-43c8-8660-b5d37b90f18c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:58.605568 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-67b2275a-9564-43c8-8660-b5d37b90f18c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:58.614643 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-67b2275a-9564-43c8-8660-b5d37b90f18c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:58.615098 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-67b2275a-9564-43c8-8660-b5d37b90f18c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:58.615874 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-67b2275a-9564-43c8-8660-b5d37b90f18c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:58.616313 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-67b2275a-9564-43c8-8660-b5d37b90f18c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:58.727111 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-67b2275a-9564-43c8-8660-b5d37b90f18c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 38216 microversion: 2.20 time: 0.129484 Dec 23 12:04:58.728511 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 365/769] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:58 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 38216 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:04:59.327274 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c0073aa4-64d6-4d1c-98b2-723d7212798a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:04:59.328426 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c0073aa4-64d6-4d1c-98b2-723d7212798a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:59.335407 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c0073aa4-64d6-4d1c-98b2-723d7212798a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:59.335870 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c0073aa4-64d6-4d1c-98b2-723d7212798a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:59.336656 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c0073aa4-64d6-4d1c-98b2-723d7212798a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:59.337098 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c0073aa4-64d6-4d1c-98b2-723d7212798a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:59.472406 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c0073aa4-64d6-4d1c-98b2-723d7212798a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:04:59.480991 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c0073aa4-64d6-4d1c-98b2-723d7212798a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1723 microversion: 2.1 time: 0.160026 Dec 23 12:04:59.481571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 405/770] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:04:59 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:04:59.747217 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b4feddcd-6776-411d-a1dd-b87356907095 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:04:59.748730 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b4feddcd-6776-411d-a1dd-b87356907095 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:04:59.756588 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b4feddcd-6776-411d-a1dd-b87356907095 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:59.757040 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b4feddcd-6776-411d-a1dd-b87356907095 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:59.757817 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b4feddcd-6776-411d-a1dd-b87356907095 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:04:59.758267 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b4feddcd-6776-411d-a1dd-b87356907095 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:04:59.859661 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b4feddcd-6776-411d-a1dd-b87356907095 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 38216 microversion: 2.20 time: 0.118503 Dec 23 12:04:59.860877 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 366/771] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:04:59 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 38216 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:05:00.502014 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1508f665-9c5e-4a64-9770-1a7b55aebffb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:00.503406 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1508f665-9c5e-4a64-9770-1a7b55aebffb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:00.510494 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1508f665-9c5e-4a64-9770-1a7b55aebffb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:00.511018 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1508f665-9c5e-4a64-9770-1a7b55aebffb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:00.511842 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1508f665-9c5e-4a64-9770-1a7b55aebffb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:00.512316 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1508f665-9c5e-4a64-9770-1a7b55aebffb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:00.654998 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1508f665-9c5e-4a64-9770-1a7b55aebffb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:00.663472 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1508f665-9c5e-4a64-9770-1a7b55aebffb tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1723 microversion: 2.1 time: 0.167669 Dec 23 12:05:00.664080 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 406/772] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:00 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:00.875416 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-7613f182-ecc7-43fd-8b72-8f2a04d081f4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:05:00.876415 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-7613f182-ecc7-43fd-8b72-8f2a04d081f4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:00.883917 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7613f182-ecc7-43fd-8b72-8f2a04d081f4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:00.884395 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7613f182-ecc7-43fd-8b72-8f2a04d081f4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:00.885192 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7613f182-ecc7-43fd-8b72-8f2a04d081f4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:00.885629 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7613f182-ecc7-43fd-8b72-8f2a04d081f4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:01.011653 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-7613f182-ecc7-43fd-8b72-8f2a04d081f4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 38287 microversion: 2.20 time: 0.139699 Dec 23 12:05:01.012725 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 367/773] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:05:00 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 38287 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:05:01.685077 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-fe59c4b8-087b-4468-9366-9fb8b5d49a82 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:01.685928 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-fe59c4b8-087b-4468-9366-9fb8b5d49a82 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:01.696746 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fe59c4b8-087b-4468-9366-9fb8b5d49a82 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:01.697492 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fe59c4b8-087b-4468-9366-9fb8b5d49a82 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:01.698814 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fe59c4b8-087b-4468-9366-9fb8b5d49a82 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:01.699536 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fe59c4b8-087b-4468-9366-9fb8b5d49a82 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:01.758491 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4a37d630-55ac-420c-a1af-ffeb47c8db9d tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:05:01.759135 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4a37d630-55ac-420c-a1af-ffeb47c8db9d tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:01.766757 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4a37d630-55ac-420c-a1af-ffeb47c8db9d tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:01.767181 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4a37d630-55ac-420c-a1af-ffeb47c8db9d tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:01.768441 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4a37d630-55ac-420c-a1af-ffeb47c8db9d tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:01.768586 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4a37d630-55ac-420c-a1af-ffeb47c8db9d tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:01.792664 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.objects.instance [None req-4a37d630-55ac-420c-a1af-ffeb47c8db9d tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lazy-loading 'flavor' on Instance uuid d087055b-27de-4c01-962a-5744a4c4cd7d {{(pid=116355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:05:01.833473 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-fe59c4b8-087b-4468-9366-9fb8b5d49a82 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:01.841811 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-fe59c4b8-087b-4468-9366-9fb8b5d49a82 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1723 microversion: 2.1 time: 0.163157 Dec 23 12:05:01.842411 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 407/774] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:01 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:01.913411 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4a37d630-55ac-420c-a1af-ffeb47c8db9d tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "POST /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d/action" status: 202 len: 0 microversion: 2.1 time: 0.158868 Dec 23 12:05:01.914009 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 368/775] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:05:01 2021] POST /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:05:01.923593 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-cf94385f-4380-4c0c-9698-40a761d17504 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:01.924258 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-cf94385f-4380-4c0c-9698-40a761d17504 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:01.930243 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cf94385f-4380-4c0c-9698-40a761d17504 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:01.930736 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cf94385f-4380-4c0c-9698-40a761d17504 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:01.931562 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cf94385f-4380-4c0c-9698-40a761d17504 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:01.931990 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cf94385f-4380-4c0c-9698-40a761d17504 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:02.025213 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-07467767-58b6-49e4-abd9-0db63ae1fd7c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:05:02.026256 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-07467767-58b6-49e4-abd9-0db63ae1fd7c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:02.034123 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-07467767-58b6-49e4-abd9-0db63ae1fd7c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:02.034799 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-07467767-58b6-49e4-abd9-0db63ae1fd7c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:02.035621 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-07467767-58b6-49e4-abd9-0db63ae1fd7c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:02.036065 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-07467767-58b6-49e4-abd9-0db63ae1fd7c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:02.073763 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-cf94385f-4380-4c0c-9698-40a761d17504 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:02.085023 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-cf94385f-4380-4c0c-9698-40a761d17504 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.164802 Dec 23 12:05:02.085749 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 408/776] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:01 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:05:02.173709 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-07467767-58b6-49e4-abd9-0db63ae1fd7c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 200 len: 38355 microversion: 2.20 time: 0.151569 Dec 23 12:05:02.175402 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 369/777] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:05:02 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 38355 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:05:02.191143 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e3c3c551-eb90-44f9-971d-d86425ad7b6f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:02.191638 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e3c3c551-eb90-44f9-971d-d86425ad7b6f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:02.198159 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e3c3c551-eb90-44f9-971d-d86425ad7b6f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:02.198639 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e3c3c551-eb90-44f9-971d-d86425ad7b6f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:02.199406 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e3c3c551-eb90-44f9-971d-d86425ad7b6f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:02.199833 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e3c3c551-eb90-44f9-971d-d86425ad7b6f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:02.224502 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e3c3c551-eb90-44f9-971d-d86425ad7b6f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/ips" status: 200 len: 152 microversion: 2.20 time: 0.038888 Dec 23 12:05:02.225058 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 409/778] 10.222.0.65 () {60 vars in 1288 bytes} [Thu Dec 23 12:05:02 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:05:02.865293 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-bb62b076-9388-4723-8a79-960ad5e48710 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:02.866448 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-bb62b076-9388-4723-8a79-960ad5e48710 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:02.878077 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bb62b076-9388-4723-8a79-960ad5e48710 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:02.878544 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bb62b076-9388-4723-8a79-960ad5e48710 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:02.879487 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bb62b076-9388-4723-8a79-960ad5e48710 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:02.879941 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bb62b076-9388-4723-8a79-960ad5e48710 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:03.019628 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-bb62b076-9388-4723-8a79-960ad5e48710 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:03.027788 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-bb62b076-9388-4723-8a79-960ad5e48710 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1723 microversion: 2.1 time: 0.170084 Dec 23 12:05:03.028356 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 370/779] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:02 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:03.102715 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e775963b-6d4f-40e0-90d5-58ecb6b5a2e1 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:03.103259 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e775963b-6d4f-40e0-90d5-58ecb6b5a2e1 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:03.110324 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e775963b-6d4f-40e0-90d5-58ecb6b5a2e1 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:03.110840 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e775963b-6d4f-40e0-90d5-58ecb6b5a2e1 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:03.111901 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e775963b-6d4f-40e0-90d5-58ecb6b5a2e1 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:03.112552 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e775963b-6d4f-40e0-90d5-58ecb6b5a2e1 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:03.259143 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e775963b-6d4f-40e0-90d5-58ecb6b5a2e1 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:03.269392 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e775963b-6d4f-40e0-90d5-58ecb6b5a2e1 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.170436 Dec 23 12:05:03.269885 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 410/780] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:03 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:04.048391 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-585c996f-9ac6-420b-ae6b-81f88145f9d5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:04.049670 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-585c996f-9ac6-420b-ae6b-81f88145f9d5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:04.056900 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-585c996f-9ac6-420b-ae6b-81f88145f9d5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:04.057360 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-585c996f-9ac6-420b-ae6b-81f88145f9d5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:04.058148 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-585c996f-9ac6-420b-ae6b-81f88145f9d5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:04.058628 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-585c996f-9ac6-420b-ae6b-81f88145f9d5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:04.200837 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-585c996f-9ac6-420b-ae6b-81f88145f9d5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:04.210255 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-585c996f-9ac6-420b-ae6b-81f88145f9d5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1723 microversion: 2.1 time: 0.168190 Dec 23 12:05:04.210894 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 371/781] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:04 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:05:04.288736 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2ded3639-84b0-4ae3-b2e4-779f955b0250 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:04.289463 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2ded3639-84b0-4ae3-b2e4-779f955b0250 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:04.297323 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2ded3639-84b0-4ae3-b2e4-779f955b0250 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:04.297875 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2ded3639-84b0-4ae3-b2e4-779f955b0250 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:04.298998 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2ded3639-84b0-4ae3-b2e4-779f955b0250 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:04.299828 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2ded3639-84b0-4ae3-b2e4-779f955b0250 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:04.392696 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0cc16593-afc4-4bee-85f6-a7f3c3af24a8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:05:04.393631 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0cc16593-afc4-4bee-85f6-a7f3c3af24a8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:04.400840 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0cc16593-afc4-4bee-85f6-a7f3c3af24a8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:04.401499 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0cc16593-afc4-4bee-85f6-a7f3c3af24a8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:04.402448 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0cc16593-afc4-4bee-85f6-a7f3c3af24a8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:04.403068 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0cc16593-afc4-4bee-85f6-a7f3c3af24a8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:04.427309 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.objects.instance [None req-0cc16593-afc4-4bee-85f6-a7f3c3af24a8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lazy-loading 'flavor' on Instance uuid b0523247-1eca-4fec-83ea-1496d8dee549 {{(pid=116355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:05:04.441744 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2ded3639-84b0-4ae3-b2e4-779f955b0250 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:04.450393 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2ded3639-84b0-4ae3-b2e4-779f955b0250 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.166138 Dec 23 12:05:04.451090 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 411/782] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:04 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:04.704800 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0cc16593-afc4-4bee-85f6-a7f3c3af24a8 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 202 len: 0 microversion: 2.20 time: 0.315557 Dec 23 12:05:04.705947 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 372/783] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:05:04 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:05:04.714953 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f0564061-6cc4-492a-b4e9-d8c26eec5941 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:04.715579 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f0564061-6cc4-492a-b4e9-d8c26eec5941 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:04.722897 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f0564061-6cc4-492a-b4e9-d8c26eec5941 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:04.723380 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f0564061-6cc4-492a-b4e9-d8c26eec5941 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:04.724210 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f0564061-6cc4-492a-b4e9-d8c26eec5941 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:04.724726 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f0564061-6cc4-492a-b4e9-d8c26eec5941 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:04.861328 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f0564061-6cc4-492a-b4e9-d8c26eec5941 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:04.869290 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f0564061-6cc4-492a-b4e9-d8c26eec5941 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:04.870786 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f0564061-6cc4-492a-b4e9-d8c26eec5941 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:04.871938 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f0564061-6cc4-492a-b4e9-d8c26eec5941 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1722 microversion: 2.20 time: 0.161626 Dec 23 12:05:04.872500 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 412/784] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:04 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:05.234924 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-20e0a05b-e8dc-4fa0-a4b6-69663f946e4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:05.237194 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-20e0a05b-e8dc-4fa0-a4b6-69663f946e4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:05.248202 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-20e0a05b-e8dc-4fa0-a4b6-69663f946e4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:05.248952 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-20e0a05b-e8dc-4fa0-a4b6-69663f946e4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:05.250225 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-20e0a05b-e8dc-4fa0-a4b6-69663f946e4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:05.251006 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-20e0a05b-e8dc-4fa0-a4b6-69663f946e4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:05.398640 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-20e0a05b-e8dc-4fa0-a4b6-69663f946e4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:05.407980 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-20e0a05b-e8dc-4fa0-a4b6-69663f946e4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1723 microversion: 2.1 time: 0.180950 Dec 23 12:05:05.409037 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 373/785] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:05 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:05.470820 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-af7a183f-11e1-4cbc-8951-2e7d52e02f2a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:05.472111 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-af7a183f-11e1-4cbc-8951-2e7d52e02f2a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:05.482238 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-af7a183f-11e1-4cbc-8951-2e7d52e02f2a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:05.483047 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-af7a183f-11e1-4cbc-8951-2e7d52e02f2a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:05.484708 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-af7a183f-11e1-4cbc-8951-2e7d52e02f2a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:05.485528 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-af7a183f-11e1-4cbc-8951-2e7d52e02f2a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:05.635719 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-af7a183f-11e1-4cbc-8951-2e7d52e02f2a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:05.647805 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-af7a183f-11e1-4cbc-8951-2e7d52e02f2a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.182791 Dec 23 12:05:05.648689 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 413/786] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:05 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:05.891229 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ffce4622-4af3-4b04-bccf-d890bd47c029 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:05.891883 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ffce4622-4af3-4b04-bccf-d890bd47c029 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:05.898235 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ffce4622-4af3-4b04-bccf-d890bd47c029 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:05.898728 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ffce4622-4af3-4b04-bccf-d890bd47c029 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:05.899505 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ffce4622-4af3-4b04-bccf-d890bd47c029 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:05.899939 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ffce4622-4af3-4b04-bccf-d890bd47c029 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:06.040844 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ffce4622-4af3-4b04-bccf-d890bd47c029 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:06.049217 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ffce4622-4af3-4b04-bccf-d890bd47c029 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:06.050752 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ffce4622-4af3-4b04-bccf-d890bd47c029 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:06.051915 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ffce4622-4af3-4b04-bccf-d890bd47c029 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1722 microversion: 2.20 time: 0.164569 Dec 23 12:05:06.052474 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 374/787] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:05 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:06.427660 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-feb25eb4-4c21-4aed-8f60-62577cd82967 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:06.428270 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-feb25eb4-4c21-4aed-8f60-62577cd82967 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:06.437463 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-feb25eb4-4c21-4aed-8f60-62577cd82967 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:06.438127 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-feb25eb4-4c21-4aed-8f60-62577cd82967 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:06.439829 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-feb25eb4-4c21-4aed-8f60-62577cd82967 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:06.440355 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-feb25eb4-4c21-4aed-8f60-62577cd82967 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:06.578117 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-feb25eb4-4c21-4aed-8f60-62577cd82967 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:06.588181 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-feb25eb4-4c21-4aed-8f60-62577cd82967 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1723 microversion: 2.1 time: 0.164536 Dec 23 12:05:06.589091 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 414/788] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:06 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:06.669097 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8260f07e-6fed-4a33-b930-d7c7f3c5a645 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:06.669626 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-8260f07e-6fed-4a33-b930-d7c7f3c5a645 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:06.676516 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8260f07e-6fed-4a33-b930-d7c7f3c5a645 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:06.676989 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8260f07e-6fed-4a33-b930-d7c7f3c5a645 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:06.677765 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8260f07e-6fed-4a33-b930-d7c7f3c5a645 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:06.678154 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8260f07e-6fed-4a33-b930-d7c7f3c5a645 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:06.811795 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-8260f07e-6fed-4a33-b930-d7c7f3c5a645 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:06.820040 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-8260f07e-6fed-4a33-b930-d7c7f3c5a645 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.154731 Dec 23 12:05:06.820614 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 375/789] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:06 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:07.075947 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-cd99d8ef-1663-4ddd-8ad7-b568ad6e76b5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:07.076561 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-cd99d8ef-1663-4ddd-8ad7-b568ad6e76b5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:07.084467 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd99d8ef-1663-4ddd-8ad7-b568ad6e76b5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:07.084917 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd99d8ef-1663-4ddd-8ad7-b568ad6e76b5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:07.085703 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd99d8ef-1663-4ddd-8ad7-b568ad6e76b5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:07.086140 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd99d8ef-1663-4ddd-8ad7-b568ad6e76b5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:07.222203 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-cd99d8ef-1663-4ddd-8ad7-b568ad6e76b5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:07.230268 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-cd99d8ef-1663-4ddd-8ad7-b568ad6e76b5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:07.231760 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-cd99d8ef-1663-4ddd-8ad7-b568ad6e76b5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:07.232921 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-cd99d8ef-1663-4ddd-8ad7-b568ad6e76b5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1722 microversion: 2.20 time: 0.161047 Dec 23 12:05:07.233483 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 415/790] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:07 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:07.613531 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-65cd0359-2de2-4646-a9bb-fd7bf931d9a1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:07.614101 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-65cd0359-2de2-4646-a9bb-fd7bf931d9a1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:07.620850 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-65cd0359-2de2-4646-a9bb-fd7bf931d9a1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:07.621301 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-65cd0359-2de2-4646-a9bb-fd7bf931d9a1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:07.622119 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-65cd0359-2de2-4646-a9bb-fd7bf931d9a1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:07.622712 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-65cd0359-2de2-4646-a9bb-fd7bf931d9a1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:07.774153 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-65cd0359-2de2-4646-a9bb-fd7bf931d9a1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:07.784080 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-65cd0359-2de2-4646-a9bb-fd7bf931d9a1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1700 microversion: 2.1 time: 0.176049 Dec 23 12:05:07.784939 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 376/791] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:07 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1700 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:07.806925 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-60bc1641-48aa-4697-846b-187a3b3b77b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:05:07.816090 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-60bc1641-48aa-4697-846b-187a3b3b77b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:07.816765 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-60bc1641-48aa-4697-846b-187a3b3b77b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:07.837378 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a9098a20-b641-427f-981e-26998fae1a29 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:07.837963 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a9098a20-b641-427f-981e-26998fae1a29 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:07.844308 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a9098a20-b641-427f-981e-26998fae1a29 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:07.844756 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a9098a20-b641-427f-981e-26998fae1a29 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:07.845533 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a9098a20-b641-427f-981e-26998fae1a29 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:07.846363 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a9098a20-b641-427f-981e-26998fae1a29 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:07.883955 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-60bc1641-48aa-4697-846b-187a3b3b77b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Going to try to start instance {{(pid=116354) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 23 12:05:07.928688 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-60bc1641-48aa-4697-846b-187a3b3b77b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 202 len: 0 microversion: 2.1 time: 0.125706 Dec 23 12:05:07.929350 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 416/792] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:05:07 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:05:07.939609 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9f99790e-3d1a-46ab-9a0c-d99ace073ac4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:07.941077 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9f99790e-3d1a-46ab-9a0c-d99ace073ac4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:07.947968 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9f99790e-3d1a-46ab-9a0c-d99ace073ac4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:07.948533 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9f99790e-3d1a-46ab-9a0c-d99ace073ac4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:07.949327 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9f99790e-3d1a-46ab-9a0c-d99ace073ac4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:07.949785 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9f99790e-3d1a-46ab-9a0c-d99ace073ac4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:07.991524 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a9098a20-b641-427f-981e-26998fae1a29 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:08.000020 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a9098a20-b641-427f-981e-26998fae1a29 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.166286 Dec 23 12:05:08.000657 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 377/793] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:07 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:08.102548 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9f99790e-3d1a-46ab-9a0c-d99ace073ac4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:08.110796 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9f99790e-3d1a-46ab-9a0c-d99ace073ac4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1709 microversion: 2.1 time: 0.175320 Dec 23 12:05:08.111414 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 417/794] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:07 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1709 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:08.254748 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ce7889fd-b3cb-4707-9e8d-198fcb4b3cc0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:08.255361 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ce7889fd-b3cb-4707-9e8d-198fcb4b3cc0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:08.262265 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ce7889fd-b3cb-4707-9e8d-198fcb4b3cc0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:08.262753 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ce7889fd-b3cb-4707-9e8d-198fcb4b3cc0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:08.263535 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ce7889fd-b3cb-4707-9e8d-198fcb4b3cc0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:08.263967 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ce7889fd-b3cb-4707-9e8d-198fcb4b3cc0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:08.453746 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ce7889fd-b3cb-4707-9e8d-198fcb4b3cc0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:08.462870 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ce7889fd-b3cb-4707-9e8d-198fcb4b3cc0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:08.464355 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ce7889fd-b3cb-4707-9e8d-198fcb4b3cc0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:08.465525 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ce7889fd-b3cb-4707-9e8d-198fcb4b3cc0 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1722 microversion: 2.20 time: 0.214576 Dec 23 12:05:08.466062 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 378/795] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:08 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:09.019606 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8892f476-e7d3-411f-a68b-0cbde88d623e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:09.020348 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8892f476-e7d3-411f-a68b-0cbde88d623e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:09.027063 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8892f476-e7d3-411f-a68b-0cbde88d623e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:09.027521 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8892f476-e7d3-411f-a68b-0cbde88d623e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:09.028301 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8892f476-e7d3-411f-a68b-0cbde88d623e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:09.028739 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8892f476-e7d3-411f-a68b-0cbde88d623e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:09.128593 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-52ffd972-bf55-4048-a6b5-eb6bb0f9fb65 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:09.129247 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-52ffd972-bf55-4048-a6b5-eb6bb0f9fb65 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:09.135720 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-52ffd972-bf55-4048-a6b5-eb6bb0f9fb65 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:09.136174 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-52ffd972-bf55-4048-a6b5-eb6bb0f9fb65 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:09.136950 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-52ffd972-bf55-4048-a6b5-eb6bb0f9fb65 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:09.137384 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-52ffd972-bf55-4048-a6b5-eb6bb0f9fb65 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:09.164501 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8892f476-e7d3-411f-a68b-0cbde88d623e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:09.172352 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8892f476-e7d3-411f-a68b-0cbde88d623e tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.157171 Dec 23 12:05:09.172920 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 418/796] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:09 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:09.268889 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-52ffd972-bf55-4048-a6b5-eb6bb0f9fb65 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:09.277172 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-52ffd972-bf55-4048-a6b5-eb6bb0f9fb65 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1709 microversion: 2.1 time: 0.152175 Dec 23 12:05:09.277712 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 379/797] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:09 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:09.488855 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-db7dfc61-7757-4430-9fdd-9a487f468d92 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:09.489867 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-db7dfc61-7757-4430-9fdd-9a487f468d92 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:09.500346 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-db7dfc61-7757-4430-9fdd-9a487f468d92 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:09.501185 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-db7dfc61-7757-4430-9fdd-9a487f468d92 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:09.502615 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-db7dfc61-7757-4430-9fdd-9a487f468d92 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:09.503198 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-db7dfc61-7757-4430-9fdd-9a487f468d92 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:09.644048 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-db7dfc61-7757-4430-9fdd-9a487f468d92 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:09.652759 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-db7dfc61-7757-4430-9fdd-9a487f468d92 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:09.654251 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-db7dfc61-7757-4430-9fdd-9a487f468d92 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:09.655457 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-db7dfc61-7757-4430-9fdd-9a487f468d92 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1722 microversion: 2.20 time: 0.173722 Dec 23 12:05:09.656029 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 419/798] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:09 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:10.193248 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a097c87c-923f-47c7-8025-b8283da6f9f2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:10.193994 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a097c87c-923f-47c7-8025-b8283da6f9f2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:10.202247 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a097c87c-923f-47c7-8025-b8283da6f9f2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:10.202867 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a097c87c-923f-47c7-8025-b8283da6f9f2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:10.203845 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a097c87c-923f-47c7-8025-b8283da6f9f2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:10.204400 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a097c87c-923f-47c7-8025-b8283da6f9f2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:10.293825 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e5de4a6b-cb06-4f3c-8a58-27981d9f0e5a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:10.294426 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e5de4a6b-cb06-4f3c-8a58-27981d9f0e5a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:10.301918 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e5de4a6b-cb06-4f3c-8a58-27981d9f0e5a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:10.302377 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e5de4a6b-cb06-4f3c-8a58-27981d9f0e5a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:10.303213 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e5de4a6b-cb06-4f3c-8a58-27981d9f0e5a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:10.303655 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e5de4a6b-cb06-4f3c-8a58-27981d9f0e5a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:10.359529 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a097c87c-923f-47c7-8025-b8283da6f9f2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:10.367446 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a097c87c-923f-47c7-8025-b8283da6f9f2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.180014 Dec 23 12:05:10.368024 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 380/799] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:10 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:10.449254 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e5de4a6b-cb06-4f3c-8a58-27981d9f0e5a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:10.464333 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e5de4a6b-cb06-4f3c-8a58-27981d9f0e5a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1713 microversion: 2.1 time: 0.173942 Dec 23 12:05:10.465261 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 420/800] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:10 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1713 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:10.677199 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f1a294f7-daa1-467a-9ec0-e47f837eb3a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:10.678029 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f1a294f7-daa1-467a-9ec0-e47f837eb3a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:10.686576 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f1a294f7-daa1-467a-9ec0-e47f837eb3a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:10.687190 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f1a294f7-daa1-467a-9ec0-e47f837eb3a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:10.688265 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f1a294f7-daa1-467a-9ec0-e47f837eb3a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:10.688851 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f1a294f7-daa1-467a-9ec0-e47f837eb3a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:10.840358 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-f1a294f7-daa1-467a-9ec0-e47f837eb3a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:10.852904 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-f1a294f7-daa1-467a-9ec0-e47f837eb3a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:10.854960 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-f1a294f7-daa1-467a-9ec0-e47f837eb3a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:10.856698 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f1a294f7-daa1-467a-9ec0-e47f837eb3a6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1722 microversion: 2.20 time: 0.185013 Dec 23 12:05:10.857482 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 381/801] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:10 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:11.385449 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-46388430-a7a8-46a9-b441-0a8358867f0c tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:11.386039 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-46388430-a7a8-46a9-b441-0a8358867f0c tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:11.393485 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-46388430-a7a8-46a9-b441-0a8358867f0c tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:11.394006 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-46388430-a7a8-46a9-b441-0a8358867f0c tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:11.394831 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-46388430-a7a8-46a9-b441-0a8358867f0c tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:11.395266 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-46388430-a7a8-46a9-b441-0a8358867f0c tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:11.813104 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-46388430-a7a8-46a9-b441-0a8358867f0c tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:11.821878 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-46388430-a7a8-46a9-b441-0a8358867f0c tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.440185 Dec 23 12:05:11.822455 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 421/802] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:11 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:11.877849 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b7c8bf80-90f0-4585-9f18-4384b5bb6726 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:11.878458 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b7c8bf80-90f0-4585-9f18-4384b5bb6726 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:11.885638 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b7c8bf80-90f0-4585-9f18-4384b5bb6726 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:11.886079 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b7c8bf80-90f0-4585-9f18-4384b5bb6726 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:11.886903 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b7c8bf80-90f0-4585-9f18-4384b5bb6726 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:11.887348 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b7c8bf80-90f0-4585-9f18-4384b5bb6726 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:12.042923 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b7c8bf80-90f0-4585-9f18-4384b5bb6726 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:12.063091 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b7c8bf80-90f0-4585-9f18-4384b5bb6726 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:12.065470 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b7c8bf80-90f0-4585-9f18-4384b5bb6726 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:12.067349 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b7c8bf80-90f0-4585-9f18-4384b5bb6726 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1722 microversion: 2.20 time: 0.193531 Dec 23 12:05:12.067939 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 382/803] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:11 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:12.842556 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c36f1d04-8844-4c14-8e45-7de742947633 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:12.843499 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c36f1d04-8844-4c14-8e45-7de742947633 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:12.852804 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c36f1d04-8844-4c14-8e45-7de742947633 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:12.853262 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c36f1d04-8844-4c14-8e45-7de742947633 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:12.854048 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c36f1d04-8844-4c14-8e45-7de742947633 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:12.854490 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c36f1d04-8844-4c14-8e45-7de742947633 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:12.995689 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c36f1d04-8844-4c14-8e45-7de742947633 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:13.004293 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c36f1d04-8844-4c14-8e45-7de742947633 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.167930 Dec 23 12:05:13.004863 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 422/804] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:12 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:13.089171 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-fab6a620-3dc3-4036-8cb7-b635625ccdaa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:13.089790 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-fab6a620-3dc3-4036-8cb7-b635625ccdaa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:13.099131 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fab6a620-3dc3-4036-8cb7-b635625ccdaa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:13.099840 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fab6a620-3dc3-4036-8cb7-b635625ccdaa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:13.101133 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fab6a620-3dc3-4036-8cb7-b635625ccdaa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:13.101848 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fab6a620-3dc3-4036-8cb7-b635625ccdaa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:13.239533 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-fab6a620-3dc3-4036-8cb7-b635625ccdaa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:13.252491 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-fab6a620-3dc3-4036-8cb7-b635625ccdaa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:13.253920 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-fab6a620-3dc3-4036-8cb7-b635625ccdaa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:13.255118 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-fab6a620-3dc3-4036-8cb7-b635625ccdaa tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1722 microversion: 2.20 time: 0.170604 Dec 23 12:05:13.255678 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 383/805] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:13 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:14.025291 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3b67cba1-d9c3-49f3-8fbf-48b44aaded02 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:14.025924 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3b67cba1-d9c3-49f3-8fbf-48b44aaded02 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:14.032687 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3b67cba1-d9c3-49f3-8fbf-48b44aaded02 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:14.033136 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3b67cba1-d9c3-49f3-8fbf-48b44aaded02 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:14.033909 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3b67cba1-d9c3-49f3-8fbf-48b44aaded02 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:14.034319 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3b67cba1-d9c3-49f3-8fbf-48b44aaded02 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:14.172365 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3b67cba1-d9c3-49f3-8fbf-48b44aaded02 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:14.181529 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3b67cba1-d9c3-49f3-8fbf-48b44aaded02 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.159900 Dec 23 12:05:14.182095 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 423/806] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:14 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:14.274316 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-63172f9a-70f3-4d99-aad2-781f5d9880c1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:14.274963 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-63172f9a-70f3-4d99-aad2-781f5d9880c1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:14.282979 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-63172f9a-70f3-4d99-aad2-781f5d9880c1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:14.283414 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-63172f9a-70f3-4d99-aad2-781f5d9880c1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:14.284328 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-63172f9a-70f3-4d99-aad2-781f5d9880c1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:14.285067 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-63172f9a-70f3-4d99-aad2-781f5d9880c1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:14.430888 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-63172f9a-70f3-4d99-aad2-781f5d9880c1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:14.442995 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-63172f9a-70f3-4d99-aad2-781f5d9880c1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:14.445274 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-63172f9a-70f3-4d99-aad2-781f5d9880c1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:14.447115 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-63172f9a-70f3-4d99-aad2-781f5d9880c1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1722 microversion: 2.20 time: 0.176991 Dec 23 12:05:14.447916 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 384/807] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:14 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:15.202822 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f13e6fea-baf7-4998-a334-7c9be5bb91a2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:15.203807 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f13e6fea-baf7-4998-a334-7c9be5bb91a2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:15.211538 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f13e6fea-baf7-4998-a334-7c9be5bb91a2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:15.212690 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f13e6fea-baf7-4998-a334-7c9be5bb91a2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:15.213488 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f13e6fea-baf7-4998-a334-7c9be5bb91a2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:15.213934 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f13e6fea-baf7-4998-a334-7c9be5bb91a2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:15.370817 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f13e6fea-baf7-4998-a334-7c9be5bb91a2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:15.378372 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f13e6fea-baf7-4998-a334-7c9be5bb91a2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.181974 Dec 23 12:05:15.378969 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 424/808] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:15 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:15.472889 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-cb2265bf-af44-481d-9af7-b2e61e7e3805 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:15.473458 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-cb2265bf-af44-481d-9af7-b2e61e7e3805 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:15.481052 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cb2265bf-af44-481d-9af7-b2e61e7e3805 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:15.481562 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cb2265bf-af44-481d-9af7-b2e61e7e3805 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:15.482431 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cb2265bf-af44-481d-9af7-b2e61e7e3805 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:15.482962 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cb2265bf-af44-481d-9af7-b2e61e7e3805 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:15.630643 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-cb2265bf-af44-481d-9af7-b2e61e7e3805 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:15.639153 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-cb2265bf-af44-481d-9af7-b2e61e7e3805 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:15.640628 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-cb2265bf-af44-481d-9af7-b2e61e7e3805 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:15.641778 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-cb2265bf-af44-481d-9af7-b2e61e7e3805 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1743 microversion: 2.20 time: 0.175208 Dec 23 12:05:15.642339 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 385/809] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:15 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:16.401216 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-44245c31-e46f-4c57-a709-947295d4fbfd tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:16.401807 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-44245c31-e46f-4c57-a709-947295d4fbfd tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:16.411070 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-44245c31-e46f-4c57-a709-947295d4fbfd tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:16.411517 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-44245c31-e46f-4c57-a709-947295d4fbfd tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:16.412288 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-44245c31-e46f-4c57-a709-947295d4fbfd tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:16.412720 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-44245c31-e46f-4c57-a709-947295d4fbfd tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:16.552335 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-44245c31-e46f-4c57-a709-947295d4fbfd tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:16.560259 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-44245c31-e46f-4c57-a709-947295d4fbfd tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.164321 Dec 23 12:05:16.560828 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 425/810] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:16 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:16.664128 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-07fe4587-e9f0-46fb-9e22-f1fce883665c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:16.664973 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-07fe4587-e9f0-46fb-9e22-f1fce883665c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:16.675910 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-07fe4587-e9f0-46fb-9e22-f1fce883665c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:16.676360 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-07fe4587-e9f0-46fb-9e22-f1fce883665c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:16.677192 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-07fe4587-e9f0-46fb-9e22-f1fce883665c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:16.677622 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-07fe4587-e9f0-46fb-9e22-f1fce883665c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:16.820835 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-07fe4587-e9f0-46fb-9e22-f1fce883665c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:16.833766 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-07fe4587-e9f0-46fb-9e22-f1fce883665c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:16.836155 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-07fe4587-e9f0-46fb-9e22-f1fce883665c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:16.837995 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-07fe4587-e9f0-46fb-9e22-f1fce883665c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1743 microversion: 2.20 time: 0.179959 Dec 23 12:05:16.838871 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 386/811] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:16 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:17.577190 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-bf03700e-c003-46b5-9851-10f1c80e0f63 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:17.578452 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-bf03700e-c003-46b5-9851-10f1c80e0f63 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:17.585474 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-bf03700e-c003-46b5-9851-10f1c80e0f63 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:17.586253 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-bf03700e-c003-46b5-9851-10f1c80e0f63 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:17.587410 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-bf03700e-c003-46b5-9851-10f1c80e0f63 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:17.588052 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-bf03700e-c003-46b5-9851-10f1c80e0f63 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:17.779615 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-bf03700e-c003-46b5-9851-10f1c80e0f63 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:17.789386 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-bf03700e-c003-46b5-9851-10f1c80e0f63 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.215761 Dec 23 12:05:17.790065 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 426/812] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:17 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:17.858122 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0d6ff2ef-ec91-4ab8-978b-c0182689a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:17.859429 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0d6ff2ef-ec91-4ab8-978b-c0182689a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:17.871728 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0d6ff2ef-ec91-4ab8-978b-c0182689a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:17.872611 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0d6ff2ef-ec91-4ab8-978b-c0182689a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:17.873987 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0d6ff2ef-ec91-4ab8-978b-c0182689a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:17.874747 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0d6ff2ef-ec91-4ab8-978b-c0182689a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:18.115760 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0d6ff2ef-ec91-4ab8-978b-c0182689a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:18.124324 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0d6ff2ef-ec91-4ab8-978b-c0182689a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:18.126457 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0d6ff2ef-ec91-4ab8-978b-c0182689a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:18.127936 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0d6ff2ef-ec91-4ab8-978b-c0182689a3cc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1738 microversion: 2.20 time: 0.275299 Dec 23 12:05:18.128483 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 387/813] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:17 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:18.809221 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-db2d02fe-e165-49b3-b68f-d39b1ddb7474 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:18.810000 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-db2d02fe-e165-49b3-b68f-d39b1ddb7474 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:18.817088 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-db2d02fe-e165-49b3-b68f-d39b1ddb7474 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:18.817809 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-db2d02fe-e165-49b3-b68f-d39b1ddb7474 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:18.818811 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-db2d02fe-e165-49b3-b68f-d39b1ddb7474 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:18.819429 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-db2d02fe-e165-49b3-b68f-d39b1ddb7474 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:18.969678 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-db2d02fe-e165-49b3-b68f-d39b1ddb7474 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:18.978362 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-db2d02fe-e165-49b3-b68f-d39b1ddb7474 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.172811 Dec 23 12:05:18.979300 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 427/814] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:18 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:19.148978 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-1f6df575-c5a2-424b-88bf-70eb2b727ab9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:19.149847 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-1f6df575-c5a2-424b-88bf-70eb2b727ab9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:19.156612 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1f6df575-c5a2-424b-88bf-70eb2b727ab9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:19.157186 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1f6df575-c5a2-424b-88bf-70eb2b727ab9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:19.158119 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1f6df575-c5a2-424b-88bf-70eb2b727ab9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:19.158676 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1f6df575-c5a2-424b-88bf-70eb2b727ab9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:19.308040 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-1f6df575-c5a2-424b-88bf-70eb2b727ab9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:19.316626 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-1f6df575-c5a2-424b-88bf-70eb2b727ab9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:19.318387 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-1f6df575-c5a2-424b-88bf-70eb2b727ab9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:19.319932 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-1f6df575-c5a2-424b-88bf-70eb2b727ab9 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1738 microversion: 2.20 time: 0.175680 Dec 23 12:05:19.320497 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 388/815] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:19 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:19.663554 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-b8750c10-5d3c-4cd8-acc1-ffbf76200b5f req-9fe1f09a-434b-4be0-9a5d-c7537a28ad64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0523247-1eca-4fec-83ea-1496d8dee549", "name": "network-vif-plugged", "status": "completed", "tag": "8c8adecf-b23d-4edb-96f6-b1d23075c761"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:05:19.666150 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:05:19.666150 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:05:19.679374 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-b8750c10-5d3c-4cd8-acc1-ffbf76200b5f req-9fe1f09a-434b-4be0-9a5d-c7537a28ad64 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:19.679983 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-b8750c10-5d3c-4cd8-acc1-ffbf76200b5f req-9fe1f09a-434b-4be0-9a5d-c7537a28ad64 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:19.692475 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-b8750c10-5d3c-4cd8-acc1-ffbf76200b5f req-9fe1f09a-434b-4be0-9a5d-c7537a28ad64 service nova] Creating event network-vif-plugged:8c8adecf-b23d-4edb-96f6-b1d23075c761 for instance b0523247-1eca-4fec-83ea-1496d8dee549 on hv-cinder-82282 Dec 23 12:05:19.699254 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-b8750c10-5d3c-4cd8-acc1-ffbf76200b5f req-9fe1f09a-434b-4be0-9a5d-c7537a28ad64 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041526 Dec 23 12:05:19.701085 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 428/816] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:05:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:05:19.996127 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-000313b8-200c-4d9c-8aef-609532d5e134 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:19.996834 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-000313b8-200c-4d9c-8aef-609532d5e134 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:20.004048 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-000313b8-200c-4d9c-8aef-609532d5e134 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:20.004663 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-000313b8-200c-4d9c-8aef-609532d5e134 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:20.005578 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-000313b8-200c-4d9c-8aef-609532d5e134 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:20.006131 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-000313b8-200c-4d9c-8aef-609532d5e134 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:20.147071 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-000313b8-200c-4d9c-8aef-609532d5e134 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:20.155660 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-000313b8-200c-4d9c-8aef-609532d5e134 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.163397 Dec 23 12:05:20.165012 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 389/817] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:19 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:20.337899 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e5b7b68a-dbbc-465c-9456-aad8cb830009 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:20.338686 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e5b7b68a-dbbc-465c-9456-aad8cb830009 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:20.345809 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e5b7b68a-dbbc-465c-9456-aad8cb830009 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:20.346248 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e5b7b68a-dbbc-465c-9456-aad8cb830009 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:20.347471 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e5b7b68a-dbbc-465c-9456-aad8cb830009 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:20.347969 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e5b7b68a-dbbc-465c-9456-aad8cb830009 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:20.503714 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e5b7b68a-dbbc-465c-9456-aad8cb830009 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:20.514553 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e5b7b68a-dbbc-465c-9456-aad8cb830009 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:20.516338 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e5b7b68a-dbbc-465c-9456-aad8cb830009 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:20.517508 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e5b7b68a-dbbc-465c-9456-aad8cb830009 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1738 microversion: 2.20 time: 0.183886 Dec 23 12:05:20.518070 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 429/818] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:20 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:21.172702 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-412f00e3-e41b-4292-b9fb-5b0dbc414451 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:21.174043 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-412f00e3-e41b-4292-b9fb-5b0dbc414451 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:21.185424 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-412f00e3-e41b-4292-b9fb-5b0dbc414451 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:21.186132 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-412f00e3-e41b-4292-b9fb-5b0dbc414451 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:21.186951 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-412f00e3-e41b-4292-b9fb-5b0dbc414451 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:21.187386 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-412f00e3-e41b-4292-b9fb-5b0dbc414451 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:21.328403 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-412f00e3-e41b-4292-b9fb-5b0dbc414451 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:21.337307 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-412f00e3-e41b-4292-b9fb-5b0dbc414451 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1569 microversion: 2.1 time: 0.168514 Dec 23 12:05:21.337919 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 390/819] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:21 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:21.355896 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a2b3f564-0203-40ba-a783-e4c94712b2c0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:05:21.357142 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a2b3f564-0203-40ba-a783-e4c94712b2c0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:21.364558 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a2b3f564-0203-40ba-a783-e4c94712b2c0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:21.365013 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a2b3f564-0203-40ba-a783-e4c94712b2c0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:21.365807 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a2b3f564-0203-40ba-a783-e4c94712b2c0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:21.366246 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a2b3f564-0203-40ba-a783-e4c94712b2c0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:21.478259 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a2b3f564-0203-40ba-a783-e4c94712b2c0 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "POST /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d/action" status: 202 len: 0 microversion: 2.1 time: 0.128300 Dec 23 12:05:21.481470 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 430/820] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:05:21 2021] POST /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:05:21.487061 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-49e0ec89-96a6-438e-bb9e-123cc17cb83d tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:21.487665 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-49e0ec89-96a6-438e-bb9e-123cc17cb83d tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:21.497131 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-49e0ec89-96a6-438e-bb9e-123cc17cb83d tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:21.497630 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-49e0ec89-96a6-438e-bb9e-123cc17cb83d tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:21.498357 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-49e0ec89-96a6-438e-bb9e-123cc17cb83d tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:21.498824 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-49e0ec89-96a6-438e-bb9e-123cc17cb83d tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:21.545290 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0bcca472-d662-4d36-99a8-59d5b2f4b8bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:21.547351 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0bcca472-d662-4d36-99a8-59d5b2f4b8bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:21.567568 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0bcca472-d662-4d36-99a8-59d5b2f4b8bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:21.568035 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0bcca472-d662-4d36-99a8-59d5b2f4b8bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:21.568856 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0bcca472-d662-4d36-99a8-59d5b2f4b8bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:21.569296 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0bcca472-d662-4d36-99a8-59d5b2f4b8bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:21.794204 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-49e0ec89-96a6-438e-bb9e-123cc17cb83d tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:21.802256 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-49e0ec89-96a6-438e-bb9e-123cc17cb83d tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1577 microversion: 2.1 time: 0.318838 Dec 23 12:05:21.803240 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 391/821] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:21 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1577 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:21.824342 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0bcca472-d662-4d36-99a8-59d5b2f4b8bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:21.833508 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0bcca472-d662-4d36-99a8-59d5b2f4b8bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:21.838040 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0bcca472-d662-4d36-99a8-59d5b2f4b8bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:21.841784 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0bcca472-d662-4d36-99a8-59d5b2f4b8bc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1738 microversion: 2.20 time: 0.308953 Dec 23 12:05:21.852867 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 431/822] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:21 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1738 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:22.822669 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-44d96dd8-3a80-40d1-b279-beb5b8bea4bf tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:22.823529 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-44d96dd8-3a80-40d1-b279-beb5b8bea4bf tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:22.830001 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-44d96dd8-3a80-40d1-b279-beb5b8bea4bf tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:22.830696 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-44d96dd8-3a80-40d1-b279-beb5b8bea4bf tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:22.831578 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-44d96dd8-3a80-40d1-b279-beb5b8bea4bf tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:22.832440 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-44d96dd8-3a80-40d1-b279-beb5b8bea4bf tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:22.860885 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-52973203-c1f5-4e59-8ab4-a4c00b950a1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:22.861794 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-52973203-c1f5-4e59-8ab4-a4c00b950a1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:22.880262 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-52973203-c1f5-4e59-8ab4-a4c00b950a1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:22.880717 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-52973203-c1f5-4e59-8ab4-a4c00b950a1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:22.891860 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-52973203-c1f5-4e59-8ab4-a4c00b950a1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:22.892500 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-52973203-c1f5-4e59-8ab4-a4c00b950a1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:23.047807 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-44d96dd8-3a80-40d1-b279-beb5b8bea4bf tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:23.057192 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-44d96dd8-3a80-40d1-b279-beb5b8bea4bf tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1519 microversion: 2.1 time: 0.241455 Dec 23 12:05:23.058640 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 392/823] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:22 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1519 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:23.163121 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-52973203-c1f5-4e59-8ab4-a4c00b950a1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:23.173737 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-52973203-c1f5-4e59-8ab4-a4c00b950a1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:23.176131 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-52973203-c1f5-4e59-8ab4-a4c00b950a1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:23.176424 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-52973203-c1f5-4e59-8ab4-a4c00b950a1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1738 microversion: 2.20 time: 0.320644 Dec 23 12:05:23.177297 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 432/824] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:22 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1738 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:05:23.663491 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-6429c3ee-5854-4fb7-8b9b-357fb31f5e83 req-3fcb6cad-8738-421c-838d-ec7ef3746d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d087055b-27de-4c01-962a-5744a4c4cd7d", "name": "network-vif-unplugged", "status": "completed", "tag": "ec4101a7-3a3b-4137-ac8f-4d9146a15ac1"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:05:23.665470 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:05:23.665470 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:05:23.673376 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-6429c3ee-5854-4fb7-8b9b-357fb31f5e83 req-3fcb6cad-8738-421c-838d-ec7ef3746d58 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:23.673801 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-6429c3ee-5854-4fb7-8b9b-357fb31f5e83 req-3fcb6cad-8738-421c-838d-ec7ef3746d58 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:23.690762 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-6429c3ee-5854-4fb7-8b9b-357fb31f5e83 req-3fcb6cad-8738-421c-838d-ec7ef3746d58 service nova] Creating event network-vif-unplugged:ec4101a7-3a3b-4137-ac8f-4d9146a15ac1 for instance d087055b-27de-4c01-962a-5744a4c4cd7d on hv-cinder-82282 Dec 23 12:05:23.696616 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-6429c3ee-5854-4fb7-8b9b-357fb31f5e83 req-3fcb6cad-8738-421c-838d-ec7ef3746d58 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037012 Dec 23 12:05:23.697423 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 393/825] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:05:23 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:05:24.075557 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ff93f95f-3aea-4e5c-9121-6d643a6917e3 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:24.077539 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ff93f95f-3aea-4e5c-9121-6d643a6917e3 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:24.088140 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ff93f95f-3aea-4e5c-9121-6d643a6917e3 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:24.088987 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ff93f95f-3aea-4e5c-9121-6d643a6917e3 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:24.089873 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ff93f95f-3aea-4e5c-9121-6d643a6917e3 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:24.090499 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ff93f95f-3aea-4e5c-9121-6d643a6917e3 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:24.200475 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c51ec2d6-03bc-48b0-86da-4b26b6a1cef2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:24.201887 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c51ec2d6-03bc-48b0-86da-4b26b6a1cef2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:24.210243 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c51ec2d6-03bc-48b0-86da-4b26b6a1cef2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:24.211022 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c51ec2d6-03bc-48b0-86da-4b26b6a1cef2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:24.212028 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c51ec2d6-03bc-48b0-86da-4b26b6a1cef2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:24.212710 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c51ec2d6-03bc-48b0-86da-4b26b6a1cef2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:24.342170 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ff93f95f-3aea-4e5c-9121-6d643a6917e3 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:24.367359 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ff93f95f-3aea-4e5c-9121-6d643a6917e3 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1575 microversion: 2.1 time: 0.295698 Dec 23 12:05:24.385241 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 433/826] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:24 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1575 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:24.502053 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c51ec2d6-03bc-48b0-86da-4b26b6a1cef2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:24.512996 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c51ec2d6-03bc-48b0-86da-4b26b6a1cef2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:24.520472 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c51ec2d6-03bc-48b0-86da-4b26b6a1cef2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:24.521784 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c51ec2d6-03bc-48b0-86da-4b26b6a1cef2 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1738 microversion: 2.20 time: 0.326145 Dec 23 12:05:24.522435 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 394/827] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:24 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1738 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:25.387222 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-6d0a0fc7-9dc9-4a32-8825-1d9b0ca87947 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:25.388713 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-6d0a0fc7-9dc9-4a32-8825-1d9b0ca87947 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:25.395114 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6d0a0fc7-9dc9-4a32-8825-1d9b0ca87947 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:25.395574 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6d0a0fc7-9dc9-4a32-8825-1d9b0ca87947 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:25.396373 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6d0a0fc7-9dc9-4a32-8825-1d9b0ca87947 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:25.396812 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6d0a0fc7-9dc9-4a32-8825-1d9b0ca87947 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:25.545719 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-559295b3-143a-4235-b07f-5d5d54780319 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:25.551961 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-559295b3-143a-4235-b07f-5d5d54780319 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:25.552644 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-6d0a0fc7-9dc9-4a32-8825-1d9b0ca87947 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:25.560581 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-6d0a0fc7-9dc9-4a32-8825-1d9b0ca87947 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1575 microversion: 2.1 time: 0.179278 Dec 23 12:05:25.561871 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-559295b3-143a-4235-b07f-5d5d54780319 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:25.562580 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-559295b3-143a-4235-b07f-5d5d54780319 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:25.563856 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-559295b3-143a-4235-b07f-5d5d54780319 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:25.564499 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-559295b3-143a-4235-b07f-5d5d54780319 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:25.570612 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 434/828] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:25 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:25.716121 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-559295b3-143a-4235-b07f-5d5d54780319 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:25.726751 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-559295b3-143a-4235-b07f-5d5d54780319 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:25.728545 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-559295b3-143a-4235-b07f-5d5d54780319 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:25.729791 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-559295b3-143a-4235-b07f-5d5d54780319 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1738 microversion: 2.20 time: 0.193209 Dec 23 12:05:25.731361 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 395/829] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:25 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:26.578052 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5830ff2b-cdd2-4cb8-83fc-08c36e7f7659 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:26.578701 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5830ff2b-cdd2-4cb8-83fc-08c36e7f7659 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:26.585998 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5830ff2b-cdd2-4cb8-83fc-08c36e7f7659 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:26.586580 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5830ff2b-cdd2-4cb8-83fc-08c36e7f7659 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:26.587470 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5830ff2b-cdd2-4cb8-83fc-08c36e7f7659 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:26.588807 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5830ff2b-cdd2-4cb8-83fc-08c36e7f7659 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:26.751681 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-5830ff2b-cdd2-4cb8-83fc-08c36e7f7659 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:26.755662 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c6d07eca-bec1-410f-aa86-4675767fbd1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:26.757532 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c6d07eca-bec1-410f-aa86-4675767fbd1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:26.762290 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5830ff2b-cdd2-4cb8-83fc-08c36e7f7659 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1575 microversion: 2.1 time: 0.188251 Dec 23 12:05:26.772894 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c6d07eca-bec1-410f-aa86-4675767fbd1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:26.772894 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c6d07eca-bec1-410f-aa86-4675767fbd1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:26.773248 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 435/830] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:26 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1575 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:26.773358 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c6d07eca-bec1-410f-aa86-4675767fbd1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:26.773358 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c6d07eca-bec1-410f-aa86-4675767fbd1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:26.920620 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c6d07eca-bec1-410f-aa86-4675767fbd1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:26.929059 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c6d07eca-bec1-410f-aa86-4675767fbd1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:26.930569 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c6d07eca-bec1-410f-aa86-4675767fbd1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:26.931772 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c6d07eca-bec1-410f-aa86-4675767fbd1e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1738 microversion: 2.20 time: 0.183993 Dec 23 12:05:26.932338 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 396/831] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:26 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:27.784601 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-733ae8ee-a7dd-40d2-96e6-84f913fcdb25 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:27.785595 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-733ae8ee-a7dd-40d2-96e6-84f913fcdb25 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:27.797227 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-733ae8ee-a7dd-40d2-96e6-84f913fcdb25 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:27.797974 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-733ae8ee-a7dd-40d2-96e6-84f913fcdb25 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:27.799300 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-733ae8ee-a7dd-40d2-96e6-84f913fcdb25 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:27.800017 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-733ae8ee-a7dd-40d2-96e6-84f913fcdb25 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:27.952193 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-95152207-c2a8-4339-87bd-93613e7e6910 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:27.953009 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-95152207-c2a8-4339-87bd-93613e7e6910 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:27.956528 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-733ae8ee-a7dd-40d2-96e6-84f913fcdb25 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:27.961533 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-95152207-c2a8-4339-87bd-93613e7e6910 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:27.961989 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-95152207-c2a8-4339-87bd-93613e7e6910 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:27.962823 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-95152207-c2a8-4339-87bd-93613e7e6910 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:27.963270 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-95152207-c2a8-4339-87bd-93613e7e6910 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:27.964593 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-733ae8ee-a7dd-40d2-96e6-84f913fcdb25 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1575 microversion: 2.1 time: 0.186197 Dec 23 12:05:27.965164 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 436/832] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:27 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:28.124642 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-95152207-c2a8-4339-87bd-93613e7e6910 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:28.133619 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-95152207-c2a8-4339-87bd-93613e7e6910 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:28.135134 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-95152207-c2a8-4339-87bd-93613e7e6910 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:28.136304 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-95152207-c2a8-4339-87bd-93613e7e6910 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1720 microversion: 2.20 time: 0.190432 Dec 23 12:05:28.136875 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 397/833] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:27 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:28.986477 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ddf5aa86-844e-48a9-aa3a-7f77716f5fd1 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:28.987395 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ddf5aa86-844e-48a9-aa3a-7f77716f5fd1 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:28.999031 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ddf5aa86-844e-48a9-aa3a-7f77716f5fd1 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:28.999786 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ddf5aa86-844e-48a9-aa3a-7f77716f5fd1 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:29.001071 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ddf5aa86-844e-48a9-aa3a-7f77716f5fd1 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:29.001795 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ddf5aa86-844e-48a9-aa3a-7f77716f5fd1 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:29.148392 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ddf5aa86-844e-48a9-aa3a-7f77716f5fd1 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:29.155051 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d827ee8c-0007-4356-874c-72e3241fe898 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:29.155668 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d827ee8c-0007-4356-874c-72e3241fe898 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:29.156928 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ddf5aa86-844e-48a9-aa3a-7f77716f5fd1 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1575 microversion: 2.1 time: 0.177734 Dec 23 12:05:29.157688 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 437/834] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:28 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:29.162782 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d827ee8c-0007-4356-874c-72e3241fe898 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:29.163239 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d827ee8c-0007-4356-874c-72e3241fe898 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:29.164039 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d827ee8c-0007-4356-874c-72e3241fe898 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:29.164477 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d827ee8c-0007-4356-874c-72e3241fe898 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:29.317956 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d827ee8c-0007-4356-874c-72e3241fe898 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:29.326542 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d827ee8c-0007-4356-874c-72e3241fe898 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:29.328070 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d827ee8c-0007-4356-874c-72e3241fe898 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:29.329241 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d827ee8c-0007-4356-874c-72e3241fe898 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1720 microversion: 2.20 time: 0.178408 Dec 23 12:05:29.329814 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 398/835] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:29 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:30.181625 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-cd5cdc64-e0cc-4cd1-9596-2fa9875b3b08 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:30.182655 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-cd5cdc64-e0cc-4cd1-9596-2fa9875b3b08 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:30.193802 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd5cdc64-e0cc-4cd1-9596-2fa9875b3b08 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:30.194577 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd5cdc64-e0cc-4cd1-9596-2fa9875b3b08 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:30.195905 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd5cdc64-e0cc-4cd1-9596-2fa9875b3b08 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:30.196637 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd5cdc64-e0cc-4cd1-9596-2fa9875b3b08 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:30.338455 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-cd5cdc64-e0cc-4cd1-9596-2fa9875b3b08 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:30.346227 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-cd5cdc64-e0cc-4cd1-9596-2fa9875b3b08 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1575 microversion: 2.1 time: 0.171506 Dec 23 12:05:30.346829 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 438/836] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:30 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:30.348207 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-1a135958-ea14-4332-b181-8b1209d86cbd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:30.349108 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-1a135958-ea14-4332-b181-8b1209d86cbd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:30.356065 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1a135958-ea14-4332-b181-8b1209d86cbd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:30.356518 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1a135958-ea14-4332-b181-8b1209d86cbd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:30.357312 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1a135958-ea14-4332-b181-8b1209d86cbd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:30.357751 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1a135958-ea14-4332-b181-8b1209d86cbd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:30.491710 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-1a135958-ea14-4332-b181-8b1209d86cbd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:30.500345 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-1a135958-ea14-4332-b181-8b1209d86cbd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:30.501815 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-1a135958-ea14-4332-b181-8b1209d86cbd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:30.503003 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-1a135958-ea14-4332-b181-8b1209d86cbd tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1720 microversion: 2.20 time: 0.158511 Dec 23 12:05:30.503558 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 399/837] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:30 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:05:31.367454 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-76a7606f-a3c6-417a-90d2-8cc102e40bb4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:31.368359 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-76a7606f-a3c6-417a-90d2-8cc102e40bb4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:31.376946 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-76a7606f-a3c6-417a-90d2-8cc102e40bb4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:31.377557 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-76a7606f-a3c6-417a-90d2-8cc102e40bb4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:31.378634 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-76a7606f-a3c6-417a-90d2-8cc102e40bb4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:31.379221 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-76a7606f-a3c6-417a-90d2-8cc102e40bb4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:31.518694 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-76a7606f-a3c6-417a-90d2-8cc102e40bb4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:31.521152 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c0f5154d-5df4-4699-b9fc-b872a445a151 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:31.521764 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c0f5154d-5df4-4699-b9fc-b872a445a151 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:31.527001 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-76a7606f-a3c6-417a-90d2-8cc102e40bb4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1575 microversion: 2.1 time: 0.165318 Dec 23 12:05:31.527786 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 439/838] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:31 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:31.535707 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c0f5154d-5df4-4699-b9fc-b872a445a151 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:31.535707 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c0f5154d-5df4-4699-b9fc-b872a445a151 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:31.535707 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c0f5154d-5df4-4699-b9fc-b872a445a151 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:31.535707 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c0f5154d-5df4-4699-b9fc-b872a445a151 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:31.667666 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c0f5154d-5df4-4699-b9fc-b872a445a151 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:31.675897 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c0f5154d-5df4-4699-b9fc-b872a445a151 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:31.678146 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c0f5154d-5df4-4699-b9fc-b872a445a151 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:31.679357 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c0f5154d-5df4-4699-b9fc-b872a445a151 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1723 microversion: 2.20 time: 0.162027 Dec 23 12:05:31.680684 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 400/839] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:31 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:31.697808 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3bea6a01-1e2b-4d5a-98e3-7ab5cecac884 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ca3610f-2aed-446e-ab61-edc870da8b06"}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:05:31.699019 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3bea6a01-1e2b-4d5a-98e3-7ab5cecac884 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:31.705482 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3bea6a01-1e2b-4d5a-98e3-7ab5cecac884 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:31.705940 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3bea6a01-1e2b-4d5a-98e3-7ab5cecac884 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:31.706783 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3bea6a01-1e2b-4d5a-98e3-7ab5cecac884 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:31.707227 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3bea6a01-1e2b-4d5a-98e3-7ab5cecac884 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:31.938783 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-bca7d915-a9fe-441c-80bb-a1ae2b55129d req-72b7d67c-f0e7-4a3a-90dc-8d61f9083c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0523247-1eca-4fec-83ea-1496d8dee549", "name": "network-vif-unplugged", "status": "completed", "tag": "8c8adecf-b23d-4edb-96f6-b1d23075c761"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:05:31.940607 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:05:31.940607 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:05:31.947584 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-bca7d915-a9fe-441c-80bb-a1ae2b55129d req-72b7d67c-f0e7-4a3a-90dc-8d61f9083c04 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:31.948149 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-bca7d915-a9fe-441c-80bb-a1ae2b55129d req-72b7d67c-f0e7-4a3a-90dc-8d61f9083c04 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:31.961962 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.compute.server_external_events [req-bca7d915-a9fe-441c-80bb-a1ae2b55129d req-72b7d67c-f0e7-4a3a-90dc-8d61f9083c04 service nova] Unable to find a host for instance b0523247-1eca-4fec-83ea-1496d8dee549. Dropping event network-vif-unplugged {{(pid=116355) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 23 12:05:31.963243 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-bca7d915-a9fe-441c-80bb-a1ae2b55129d req-72b7d67c-f0e7-4a3a-90dc-8d61f9083c04 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027957 Dec 23 12:05:31.964242 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 401/840] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:05:31 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 23 12:05:31.994166 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3bea6a01-1e2b-4d5a-98e3-7ab5cecac884 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300292 Dec 23 12:05:31.994907 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 440/841] 10.222.0.65 () {62 vars in 1363 bytes} [Thu Dec 23 12:05:31 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:05:32.111531 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5f7234e2-9344-4ac2-80fa-73f03956946b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:32.112039 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5f7234e2-9344-4ac2-80fa-73f03956946b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:32.118950 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5f7234e2-9344-4ac2-80fa-73f03956946b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:32.119408 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5f7234e2-9344-4ac2-80fa-73f03956946b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:32.120217 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5f7234e2-9344-4ac2-80fa-73f03956946b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:32.120662 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5f7234e2-9344-4ac2-80fa-73f03956946b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:32.392453 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5f7234e2-9344-4ac2-80fa-73f03956946b tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/os-volume_attachments/8ca3610f-2aed-446e-ab61-edc870da8b06" status: 202 len: 0 microversion: 2.20 time: 0.285070 Dec 23 12:05:32.393072 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 402/842] 10.222.0.65 () {60 vars in 1456 bytes} [Thu Dec 23 12:05:32 2021] DELETE /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/os-volume_attachments/8ca3610f-2aed-446e-ab61-edc870da8b06 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:05:32.460303 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-958eec79-3591-4a6d-95b5-e93cd23594fc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:05:32.460865 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-958eec79-3591-4a6d-95b5-e93cd23594fc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:32.467980 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-958eec79-3591-4a6d-95b5-e93cd23594fc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:32.468436 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-958eec79-3591-4a6d-95b5-e93cd23594fc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:32.469215 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-958eec79-3591-4a6d-95b5-e93cd23594fc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:32.469648 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-958eec79-3591-4a6d-95b5-e93cd23594fc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:32.544714 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ef9d340c-0a70-402d-8d3b-b66dbc90c8cf tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:32.545337 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ef9d340c-0a70-402d-8d3b-b66dbc90c8cf tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:32.547866 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-958eec79-3591-4a6d-95b5-e93cd23594fc tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action" status: 202 len: 0 microversion: 2.20 time: 0.092555 Dec 23 12:05:32.548356 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 441/843] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Dec 23 12:05:32 2021] POST /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:05:32.554143 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ef9d340c-0a70-402d-8d3b-b66dbc90c8cf tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:32.554883 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ef9d340c-0a70-402d-8d3b-b66dbc90c8cf tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:32.556037 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ef9d340c-0a70-402d-8d3b-b66dbc90c8cf tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:32.556499 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-53746e2b-e11c-4380-a1de-0844091d690d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:32.556870 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ef9d340c-0a70-402d-8d3b-b66dbc90c8cf tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:32.557126 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-53746e2b-e11c-4380-a1de-0844091d690d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:32.563413 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-53746e2b-e11c-4380-a1de-0844091d690d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:32.563876 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-53746e2b-e11c-4380-a1de-0844091d690d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:32.564672 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-53746e2b-e11c-4380-a1de-0844091d690d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:32.565112 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-53746e2b-e11c-4380-a1de-0844091d690d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:32.770064 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ef9d340c-0a70-402d-8d3b-b66dbc90c8cf tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:32.774170 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-53746e2b-e11c-4380-a1de-0844091d690d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:32.788343 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ef9d340c-0a70-402d-8d3b-b66dbc90c8cf tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1575 microversion: 2.1 time: 0.247243 Dec 23 12:05:32.797659 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-53746e2b-e11c-4380-a1de-0844091d690d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:32.797659 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-53746e2b-e11c-4380-a1de-0844091d690d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:32.797919 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 403/844] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:32 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1575 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:32.798035 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-53746e2b-e11c-4380-a1de-0844091d690d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1671 microversion: 2.20 time: 0.241276 Dec 23 12:05:32.798035 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 442/845] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:32 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1671 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:33.806482 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-992a04b4-980e-4b8f-8378-fa99834c6d84 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:33.807137 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-992a04b4-980e-4b8f-8378-fa99834c6d84 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:33.814563 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d4a39980-a7ce-46b0-a5e6-69992fd8d364 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:33.815131 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d4a39980-a7ce-46b0-a5e6-69992fd8d364 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:33.819630 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-992a04b4-980e-4b8f-8378-fa99834c6d84 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:33.820185 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-992a04b4-980e-4b8f-8378-fa99834c6d84 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:33.821071 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-992a04b4-980e-4b8f-8378-fa99834c6d84 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:33.821580 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-992a04b4-980e-4b8f-8378-fa99834c6d84 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:33.823854 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d4a39980-a7ce-46b0-a5e6-69992fd8d364 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:33.824243 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d4a39980-a7ce-46b0-a5e6-69992fd8d364 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:33.825037 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d4a39980-a7ce-46b0-a5e6-69992fd8d364 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:33.825533 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d4a39980-a7ce-46b0-a5e6-69992fd8d364 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:34.014480 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-992a04b4-980e-4b8f-8378-fa99834c6d84 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:34.021197 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-d4a39980-a7ce-46b0-a5e6-69992fd8d364 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:34.024151 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-992a04b4-980e-4b8f-8378-fa99834c6d84 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1575 microversion: 2.1 time: 0.222279 Dec 23 12:05:34.024747 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 404/846] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:33 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:05:34.029155 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-eb02f4f8-96aa-46a6-9789-8c015dd4948f req-571e6b40-f381-4720-8d52-0d381e983a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d087055b-27de-4c01-962a-5744a4c4cd7d", "name": "network-vif-plugged", "status": "completed", "tag": "ec4101a7-3a3b-4137-ac8f-4d9146a15ac1"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:05:34.029472 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-d4a39980-a7ce-46b0-a5e6-69992fd8d364 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:34.030785 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:05:34.030785 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:05:34.030983 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-d4a39980-a7ce-46b0-a5e6-69992fd8d364 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:34.032137 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d4a39980-a7ce-46b0-a5e6-69992fd8d364 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.223668 Dec 23 12:05:34.032854 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 443/847] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:33 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:05:34.038416 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-eb02f4f8-96aa-46a6-9789-8c015dd4948f req-571e6b40-f381-4720-8d52-0d381e983a62 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:34.038898 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-eb02f4f8-96aa-46a6-9789-8c015dd4948f req-571e6b40-f381-4720-8d52-0d381e983a62 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:34.050097 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-eb02f4f8-96aa-46a6-9789-8c015dd4948f req-571e6b40-f381-4720-8d52-0d381e983a62 service nova] Creating event network-vif-plugged:ec4101a7-3a3b-4137-ac8f-4d9146a15ac1 for instance d087055b-27de-4c01-962a-5744a4c4cd7d on hv-cinder-82282 Dec 23 12:05:34.055898 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-eb02f4f8-96aa-46a6-9789-8c015dd4948f req-571e6b40-f381-4720-8d52-0d381e983a62 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029994 Dec 23 12:05:34.056477 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 405/848] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:05:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:05:35.041777 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-40b0629a-208f-410c-b010-0995b5760415 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:35.042388 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-40b0629a-208f-410c-b010-0995b5760415 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:35.050266 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-40b0629a-208f-410c-b010-0995b5760415 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:35.050756 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-40b0629a-208f-410c-b010-0995b5760415 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:35.051554 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-40b0629a-208f-410c-b010-0995b5760415 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:35.051989 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-40b0629a-208f-410c-b010-0995b5760415 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:35.052694 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-89bc6481-a5e0-4833-9940-91fda3f78f56 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:35.053890 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-89bc6481-a5e0-4833-9940-91fda3f78f56 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:35.060372 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-89bc6481-a5e0-4833-9940-91fda3f78f56 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:35.061054 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-89bc6481-a5e0-4833-9940-91fda3f78f56 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:35.061991 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-89bc6481-a5e0-4833-9940-91fda3f78f56 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:35.062598 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-89bc6481-a5e0-4833-9940-91fda3f78f56 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:35.591570 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-40b0629a-208f-410c-b010-0995b5760415 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:35.599389 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-40b0629a-208f-410c-b010-0995b5760415 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1575 microversion: 2.1 time: 0.561094 Dec 23 12:05:35.599958 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 444/849] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:35 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1575 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:35.628069 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-89bc6481-a5e0-4833-9940-91fda3f78f56 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:35.636454 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-89bc6481-a5e0-4833-9940-91fda3f78f56 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:35.637903 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-89bc6481-a5e0-4833-9940-91fda3f78f56 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:35.639100 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-89bc6481-a5e0-4833-9940-91fda3f78f56 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.591974 Dec 23 12:05:35.639690 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 406/850] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:35 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:36.616918 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d8478d98-1d00-462f-a514-a3d7b164b705 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:36.617508 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d8478d98-1d00-462f-a514-a3d7b164b705 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:36.624431 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d8478d98-1d00-462f-a514-a3d7b164b705 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:36.624878 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d8478d98-1d00-462f-a514-a3d7b164b705 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:36.625664 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d8478d98-1d00-462f-a514-a3d7b164b705 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:36.626092 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d8478d98-1d00-462f-a514-a3d7b164b705 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:36.659501 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0ade06c3-e748-4f1d-8b7b-4ddfa0897a40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:36.659501 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0ade06c3-e748-4f1d-8b7b-4ddfa0897a40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:36.664940 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0ade06c3-e748-4f1d-8b7b-4ddfa0897a40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:36.665389 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0ade06c3-e748-4f1d-8b7b-4ddfa0897a40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:36.666169 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0ade06c3-e748-4f1d-8b7b-4ddfa0897a40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:36.666702 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0ade06c3-e748-4f1d-8b7b-4ddfa0897a40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:36.827112 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-d8478d98-1d00-462f-a514-a3d7b164b705 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:36.834849 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d8478d98-1d00-462f-a514-a3d7b164b705 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1562 microversion: 2.1 time: 0.221803 Dec 23 12:05:36.836014 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 445/851] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:05:36 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1562 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:05:36.851634 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0ade06c3-e748-4f1d-8b7b-4ddfa0897a40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:36.859994 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0ade06c3-e748-4f1d-8b7b-4ddfa0897a40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:36.861472 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0ade06c3-e748-4f1d-8b7b-4ddfa0897a40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:36.862657 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0ade06c3-e748-4f1d-8b7b-4ddfa0897a40 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.209244 Dec 23 12:05:36.863210 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 407/852] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:36 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 23 12:05:37.881202 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f2fadd53-ae34-4b79-b465-b92b678ffb2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:37.882067 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f2fadd53-ae34-4b79-b465-b92b678ffb2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:37.888674 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f2fadd53-ae34-4b79-b465-b92b678ffb2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:37.889124 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f2fadd53-ae34-4b79-b465-b92b678ffb2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:37.889914 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f2fadd53-ae34-4b79-b465-b92b678ffb2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:37.890345 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f2fadd53-ae34-4b79-b465-b92b678ffb2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:38.025138 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f2fadd53-ae34-4b79-b465-b92b678ffb2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:38.033323 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f2fadd53-ae34-4b79-b465-b92b678ffb2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:38.034849 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f2fadd53-ae34-4b79-b465-b92b678ffb2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:38.036050 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f2fadd53-ae34-4b79-b465-b92b678ffb2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.158770 Dec 23 12:05:38.036882 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 446/853] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:37 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:39.055020 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-44e7775b-9c7b-4805-89c3-e7a066c9e6b4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:39.055641 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-44e7775b-9c7b-4805-89c3-e7a066c9e6b4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:39.062389 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-44e7775b-9c7b-4805-89c3-e7a066c9e6b4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:39.062870 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-44e7775b-9c7b-4805-89c3-e7a066c9e6b4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:39.063654 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-44e7775b-9c7b-4805-89c3-e7a066c9e6b4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:39.064085 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-44e7775b-9c7b-4805-89c3-e7a066c9e6b4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:39.206143 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-44e7775b-9c7b-4805-89c3-e7a066c9e6b4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:39.215398 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-44e7775b-9c7b-4805-89c3-e7a066c9e6b4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:39.216922 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-44e7775b-9c7b-4805-89c3-e7a066c9e6b4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:39.218099 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-44e7775b-9c7b-4805-89c3-e7a066c9e6b4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.167081 Dec 23 12:05:39.218685 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 408/854] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:39 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:40.236892 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ce4a79f5-3bcc-4401-9329-1d60ab5e0f3f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:40.238203 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ce4a79f5-3bcc-4401-9329-1d60ab5e0f3f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:40.245438 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ce4a79f5-3bcc-4401-9329-1d60ab5e0f3f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:40.245895 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ce4a79f5-3bcc-4401-9329-1d60ab5e0f3f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:40.246711 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ce4a79f5-3bcc-4401-9329-1d60ab5e0f3f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:40.247133 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ce4a79f5-3bcc-4401-9329-1d60ab5e0f3f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:40.389259 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ce4a79f5-3bcc-4401-9329-1d60ab5e0f3f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:40.397761 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ce4a79f5-3bcc-4401-9329-1d60ab5e0f3f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:40.399280 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ce4a79f5-3bcc-4401-9329-1d60ab5e0f3f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:40.401122 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ce4a79f5-3bcc-4401-9329-1d60ab5e0f3f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.168376 Dec 23 12:05:40.401681 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 447/855] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:40 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:41.420059 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e9c610e2-e0ec-4436-bc06-ac2a6452da7e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:41.420910 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e9c610e2-e0ec-4436-bc06-ac2a6452da7e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:41.427672 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e9c610e2-e0ec-4436-bc06-ac2a6452da7e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:41.428148 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e9c610e2-e0ec-4436-bc06-ac2a6452da7e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:41.428945 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e9c610e2-e0ec-4436-bc06-ac2a6452da7e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:41.429531 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e9c610e2-e0ec-4436-bc06-ac2a6452da7e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:41.581507 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e9c610e2-e0ec-4436-bc06-ac2a6452da7e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:41.589711 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e9c610e2-e0ec-4436-bc06-ac2a6452da7e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:41.591220 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e9c610e2-e0ec-4436-bc06-ac2a6452da7e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:41.592497 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e9c610e2-e0ec-4436-bc06-ac2a6452da7e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.176780 Dec 23 12:05:41.593074 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 409/856] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:41 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:42.611613 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2ccdc4c3-c746-43c6-8f4a-7f8ec82c28b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:42.612206 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2ccdc4c3-c746-43c6-8f4a-7f8ec82c28b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:42.618715 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2ccdc4c3-c746-43c6-8f4a-7f8ec82c28b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:42.619598 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2ccdc4c3-c746-43c6-8f4a-7f8ec82c28b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:42.620448 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2ccdc4c3-c746-43c6-8f4a-7f8ec82c28b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:42.620885 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2ccdc4c3-c746-43c6-8f4a-7f8ec82c28b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:42.755971 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2ccdc4c3-c746-43c6-8f4a-7f8ec82c28b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:42.765050 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2ccdc4c3-c746-43c6-8f4a-7f8ec82c28b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:42.766534 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2ccdc4c3-c746-43c6-8f4a-7f8ec82c28b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:42.767711 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2ccdc4c3-c746-43c6-8f4a-7f8ec82c28b1 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.160437 Dec 23 12:05:42.768277 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 448/857] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:42 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:43.785441 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-865626c3-548e-4f3d-827c-5280b9b4e3d4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:43.786126 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-865626c3-548e-4f3d-827c-5280b9b4e3d4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:43.793135 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-865626c3-548e-4f3d-827c-5280b9b4e3d4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:43.793678 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-865626c3-548e-4f3d-827c-5280b9b4e3d4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:43.794549 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-865626c3-548e-4f3d-827c-5280b9b4e3d4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:43.795091 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-865626c3-548e-4f3d-827c-5280b9b4e3d4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:43.944010 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-865626c3-548e-4f3d-827c-5280b9b4e3d4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:43.952664 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-865626c3-548e-4f3d-827c-5280b9b4e3d4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:43.954156 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-865626c3-548e-4f3d-827c-5280b9b4e3d4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:43.955478 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-865626c3-548e-4f3d-827c-5280b9b4e3d4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.173673 Dec 23 12:05:43.957652 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 410/858] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:43 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:44.973349 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-92f20bf6-0299-4833-abb9-dc6c2bd69bca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:44.974226 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-92f20bf6-0299-4833-abb9-dc6c2bd69bca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:44.980840 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-92f20bf6-0299-4833-abb9-dc6c2bd69bca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:44.981284 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-92f20bf6-0299-4833-abb9-dc6c2bd69bca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:44.982069 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-92f20bf6-0299-4833-abb9-dc6c2bd69bca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:44.982532 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-92f20bf6-0299-4833-abb9-dc6c2bd69bca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:45.120564 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-92f20bf6-0299-4833-abb9-dc6c2bd69bca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:45.128765 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-92f20bf6-0299-4833-abb9-dc6c2bd69bca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:45.130231 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-92f20bf6-0299-4833-abb9-dc6c2bd69bca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:45.131427 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-92f20bf6-0299-4833-abb9-dc6c2bd69bca tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.161842 Dec 23 12:05:45.132184 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 449/859] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:44 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:46.149308 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4b5298b9-a921-41c7-81a8-c54c005fbf10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:46.149939 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4b5298b9-a921-41c7-81a8-c54c005fbf10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:46.157436 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4b5298b9-a921-41c7-81a8-c54c005fbf10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:46.157854 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4b5298b9-a921-41c7-81a8-c54c005fbf10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:46.158731 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4b5298b9-a921-41c7-81a8-c54c005fbf10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:46.159156 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4b5298b9-a921-41c7-81a8-c54c005fbf10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:46.295308 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4b5298b9-a921-41c7-81a8-c54c005fbf10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:46.304069 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4b5298b9-a921-41c7-81a8-c54c005fbf10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:46.305691 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4b5298b9-a921-41c7-81a8-c54c005fbf10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:46.307186 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4b5298b9-a921-41c7-81a8-c54c005fbf10 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.161611 Dec 23 12:05:46.307740 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 411/860] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:46 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:47.328070 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e0b04a4b-a282-42c4-b456-07fa12939d1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:47.328981 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e0b04a4b-a282-42c4-b456-07fa12939d1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:47.335833 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e0b04a4b-a282-42c4-b456-07fa12939d1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:47.336282 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e0b04a4b-a282-42c4-b456-07fa12939d1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:47.337108 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e0b04a4b-a282-42c4-b456-07fa12939d1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:47.337547 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e0b04a4b-a282-42c4-b456-07fa12939d1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:47.479160 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e0b04a4b-a282-42c4-b456-07fa12939d1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:47.488716 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e0b04a4b-a282-42c4-b456-07fa12939d1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:47.490252 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e0b04a4b-a282-42c4-b456-07fa12939d1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:47.491605 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e0b04a4b-a282-42c4-b456-07fa12939d1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.167701 Dec 23 12:05:47.492151 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 450/861] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:47 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:48.510217 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-48cda3ef-cc48-4062-8bad-1edff59907c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:48.510983 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-48cda3ef-cc48-4062-8bad-1edff59907c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:48.517965 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-48cda3ef-cc48-4062-8bad-1edff59907c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:48.518534 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-48cda3ef-cc48-4062-8bad-1edff59907c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:48.519519 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-48cda3ef-cc48-4062-8bad-1edff59907c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:48.520051 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-48cda3ef-cc48-4062-8bad-1edff59907c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:48.655483 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-48cda3ef-cc48-4062-8bad-1edff59907c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:48.663745 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-48cda3ef-cc48-4062-8bad-1edff59907c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:48.665232 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-48cda3ef-cc48-4062-8bad-1edff59907c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:48.666390 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-48cda3ef-cc48-4062-8bad-1edff59907c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.159952 Dec 23 12:05:48.666990 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 412/862] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:48 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:49.684955 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7c8511e3-40de-40a4-b0f1-43bfee034c89 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:49.685674 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-7c8511e3-40de-40a4-b0f1-43bfee034c89 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:49.692856 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7c8511e3-40de-40a4-b0f1-43bfee034c89 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:49.693277 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7c8511e3-40de-40a4-b0f1-43bfee034c89 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:49.694094 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7c8511e3-40de-40a4-b0f1-43bfee034c89 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:49.694546 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7c8511e3-40de-40a4-b0f1-43bfee034c89 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:49.837500 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-7c8511e3-40de-40a4-b0f1-43bfee034c89 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:49.846035 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-7c8511e3-40de-40a4-b0f1-43bfee034c89 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:49.847569 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-7c8511e3-40de-40a4-b0f1-43bfee034c89 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:49.848830 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-7c8511e3-40de-40a4-b0f1-43bfee034c89 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.167696 Dec 23 12:05:49.849404 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 451/863] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:49 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:50.871655 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-9e089c88-8e07-485f-8bdb-54ded7591c6a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:50.872619 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-9e089c88-8e07-485f-8bdb-54ded7591c6a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:50.883270 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9e089c88-8e07-485f-8bdb-54ded7591c6a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:50.884022 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9e089c88-8e07-485f-8bdb-54ded7591c6a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:50.885295 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9e089c88-8e07-485f-8bdb-54ded7591c6a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:50.886053 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9e089c88-8e07-485f-8bdb-54ded7591c6a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:51.023837 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-9e089c88-8e07-485f-8bdb-54ded7591c6a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:51.034831 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-9e089c88-8e07-485f-8bdb-54ded7591c6a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:51.036333 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-9e089c88-8e07-485f-8bdb-54ded7591c6a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:51.037502 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-9e089c88-8e07-485f-8bdb-54ded7591c6a tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.172256 Dec 23 12:05:51.038066 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 413/864] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:50 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:52.061527 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ad8b0e77-8392-4b7c-ac57-6544cd59efae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:52.062200 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ad8b0e77-8392-4b7c-ac57-6544cd59efae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:52.069224 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ad8b0e77-8392-4b7c-ac57-6544cd59efae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:52.069675 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ad8b0e77-8392-4b7c-ac57-6544cd59efae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:52.070462 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ad8b0e77-8392-4b7c-ac57-6544cd59efae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:52.070950 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ad8b0e77-8392-4b7c-ac57-6544cd59efae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:52.214054 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ad8b0e77-8392-4b7c-ac57-6544cd59efae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:52.222618 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ad8b0e77-8392-4b7c-ac57-6544cd59efae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:52.224139 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ad8b0e77-8392-4b7c-ac57-6544cd59efae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:52.225306 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ad8b0e77-8392-4b7c-ac57-6544cd59efae tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.167686 Dec 23 12:05:52.225876 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 452/865] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:52 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:53.244570 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-aeab1d16-84ad-4e06-818c-f36c183a24a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:53.245195 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-aeab1d16-84ad-4e06-818c-f36c183a24a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:53.252060 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aeab1d16-84ad-4e06-818c-f36c183a24a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:53.252514 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aeab1d16-84ad-4e06-818c-f36c183a24a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:53.253298 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aeab1d16-84ad-4e06-818c-f36c183a24a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:53.253740 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aeab1d16-84ad-4e06-818c-f36c183a24a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:53.398311 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-aeab1d16-84ad-4e06-818c-f36c183a24a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:53.406938 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-aeab1d16-84ad-4e06-818c-f36c183a24a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:53.408432 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-aeab1d16-84ad-4e06-818c-f36c183a24a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:53.409591 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-aeab1d16-84ad-4e06-818c-f36c183a24a5 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.168904 Dec 23 12:05:53.410127 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 414/866] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:53 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:54.430378 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e2701492-dd41-4153-800e-23bedb0b3ef7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:54.431253 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e2701492-dd41-4153-800e-23bedb0b3ef7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:54.440194 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2701492-dd41-4153-800e-23bedb0b3ef7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:54.441102 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2701492-dd41-4153-800e-23bedb0b3ef7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:54.442167 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2701492-dd41-4153-800e-23bedb0b3ef7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:54.442801 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2701492-dd41-4153-800e-23bedb0b3ef7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:54.582385 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e2701492-dd41-4153-800e-23bedb0b3ef7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:54.590130 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e2701492-dd41-4153-800e-23bedb0b3ef7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:54.591641 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e2701492-dd41-4153-800e-23bedb0b3ef7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:54.592790 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e2701492-dd41-4153-800e-23bedb0b3ef7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.167824 Dec 23 12:05:54.593315 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 453/867] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:54 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:55.616848 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a696e81a-c311-496b-b289-e294120ec673 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:55.617654 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a696e81a-c311-496b-b289-e294120ec673 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:55.629832 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a696e81a-c311-496b-b289-e294120ec673 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:55.630309 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a696e81a-c311-496b-b289-e294120ec673 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:55.631496 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a696e81a-c311-496b-b289-e294120ec673 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:55.632285 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a696e81a-c311-496b-b289-e294120ec673 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:55.797811 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a696e81a-c311-496b-b289-e294120ec673 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:55.806379 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a696e81a-c311-496b-b289-e294120ec673 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:55.807879 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a696e81a-c311-496b-b289-e294120ec673 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:55.809035 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a696e81a-c311-496b-b289-e294120ec673 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.196250 Dec 23 12:05:55.809599 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 415/868] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:55 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:55.954366 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-e862fc1e-d9b9-47ec-ade2-107c272995c3 req-469c4564-8f70-465e-ae44-c1002942d622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0523247-1eca-4fec-83ea-1496d8dee549", "name": "network-vif-plugged", "status": "completed", "tag": "8c8adecf-b23d-4edb-96f6-b1d23075c761"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:05:55.956022 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:05:55.956022 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:05:55.963628 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-e862fc1e-d9b9-47ec-ade2-107c272995c3 req-469c4564-8f70-465e-ae44-c1002942d622 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:55.964076 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-e862fc1e-d9b9-47ec-ade2-107c272995c3 req-469c4564-8f70-465e-ae44-c1002942d622 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:55.975112 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-e862fc1e-d9b9-47ec-ade2-107c272995c3 req-469c4564-8f70-465e-ae44-c1002942d622 service nova] Creating event network-vif-plugged:8c8adecf-b23d-4edb-96f6-b1d23075c761 for instance b0523247-1eca-4fec-83ea-1496d8dee549 on hv-cinder-82282 Dec 23 12:05:55.980457 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-e862fc1e-d9b9-47ec-ade2-107c272995c3 req-469c4564-8f70-465e-ae44-c1002942d622 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029813 Dec 23 12:05:55.981219 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 454/869] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:05:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:05:56.828136 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c5e4d338-19db-40c1-9896-7d1e9050859f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:56.828712 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c5e4d338-19db-40c1-9896-7d1e9050859f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:56.835656 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c5e4d338-19db-40c1-9896-7d1e9050859f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:56.836110 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c5e4d338-19db-40c1-9896-7d1e9050859f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:56.836896 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c5e4d338-19db-40c1-9896-7d1e9050859f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:56.837338 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c5e4d338-19db-40c1-9896-7d1e9050859f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:56.977559 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c5e4d338-19db-40c1-9896-7d1e9050859f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:56.990291 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c5e4d338-19db-40c1-9896-7d1e9050859f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:56.992622 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c5e4d338-19db-40c1-9896-7d1e9050859f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:56.993938 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c5e4d338-19db-40c1-9896-7d1e9050859f tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.169546 Dec 23 12:05:56.994536 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 416/870] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:56 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:58.013322 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4445a2e1-0da9-4dd9-b51c-49c541929a86 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:58.014031 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4445a2e1-0da9-4dd9-b51c-49c541929a86 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:58.020707 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4445a2e1-0da9-4dd9-b51c-49c541929a86 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:58.021191 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4445a2e1-0da9-4dd9-b51c-49c541929a86 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:58.021964 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4445a2e1-0da9-4dd9-b51c-49c541929a86 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:58.022393 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4445a2e1-0da9-4dd9-b51c-49c541929a86 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:58.155973 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4445a2e1-0da9-4dd9-b51c-49c541929a86 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:58.170927 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4445a2e1-0da9-4dd9-b51c-49c541929a86 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:58.172468 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4445a2e1-0da9-4dd9-b51c-49c541929a86 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:58.173655 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4445a2e1-0da9-4dd9-b51c-49c541929a86 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1729 microversion: 2.20 time: 0.165014 Dec 23 12:05:58.174272 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 455/871] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:58 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:05:58.633998 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0ce284e1-c21f-4bd6-8f4e-e45d0bf6916f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:58.634577 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0ce284e1-c21f-4bd6-8f4e-e45d0bf6916f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:58.642161 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0ce284e1-c21f-4bd6-8f4e-e45d0bf6916f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:58.642700 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0ce284e1-c21f-4bd6-8f4e-e45d0bf6916f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:58.643564 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0ce284e1-c21f-4bd6-8f4e-e45d0bf6916f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:58.644560 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0ce284e1-c21f-4bd6-8f4e-e45d0bf6916f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:58.731451 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.objects.instance [None req-0ce284e1-c21f-4bd6-8f4e-e45d0bf6916f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lazy-loading 'services' on Instance uuid f3b18df5-9ce3-44cb-8a62-730a959e46ac {{(pid=116355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:05:58.805353 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0ce284e1-c21f-4bd6-8f4e-e45d0bf6916f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/os-volume_attachments/5b0f217a-da1a-410d-a029-be99437cd314" status: 202 len: 0 microversion: 2.1 time: 0.175447 Dec 23 12:05:58.805963 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 417/872] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Dec 23 12:05:58 2021] DELETE /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/os-volume_attachments/5b0f217a-da1a-410d-a029-be99437cd314 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:05:59.193780 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-fcb3fb0d-b269-48c3-8196-622c185e1b84 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:05:59.194395 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-fcb3fb0d-b269-48c3-8196-622c185e1b84 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:05:59.201483 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fcb3fb0d-b269-48c3-8196-622c185e1b84 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:59.201965 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fcb3fb0d-b269-48c3-8196-622c185e1b84 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:59.202828 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fcb3fb0d-b269-48c3-8196-622c185e1b84 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:05:59.203298 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fcb3fb0d-b269-48c3-8196-622c185e1b84 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:05:59.353082 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-fcb3fb0d-b269-48c3-8196-622c185e1b84 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:59.364842 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-fcb3fb0d-b269-48c3-8196-622c185e1b84 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:59.367203 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-fcb3fb0d-b269-48c3-8196-622c185e1b84 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:05:59.369032 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-fcb3fb0d-b269-48c3-8196-622c185e1b84 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1716 microversion: 2.20 time: 0.180190 Dec 23 12:05:59.369791 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 456/873] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:05:59 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1716 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:06:00.993633 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3b54c2ce-b663-4a9c-9dda-19860a2421a2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:06:01.000636 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3b54c2ce-b663-4a9c-9dda-19860a2421a2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:01.001101 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3b54c2ce-b663-4a9c-9dda-19860a2421a2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:01.027459 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3b54c2ce-b663-4a9c-9dda-19860a2421a2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Going to try to stop instance {{(pid=116355) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 23 12:06:01.084773 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3b54c2ce-b663-4a9c-9dda-19860a2421a2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 202 len: 0 microversion: 2.1 time: 0.095774 Dec 23 12:06:01.085387 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 418/874] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:06:00 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:06:01.094227 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f1229de0-fe77-4ae0-98b3-8ce0956378a0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:01.094847 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f1229de0-fe77-4ae0-98b3-8ce0956378a0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:01.102183 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f1229de0-fe77-4ae0-98b3-8ce0956378a0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:01.102775 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f1229de0-fe77-4ae0-98b3-8ce0956378a0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:01.103575 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f1229de0-fe77-4ae0-98b3-8ce0956378a0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:01.104016 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f1229de0-fe77-4ae0-98b3-8ce0956378a0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:01.246619 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f1229de0-fe77-4ae0-98b3-8ce0956378a0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:01.254717 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f1229de0-fe77-4ae0-98b3-8ce0956378a0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1677 microversion: 2.1 time: 0.164178 Dec 23 12:06:01.255282 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 457/875] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:06:01 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:06:02.279797 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e2864b10-9ce4-4380-bb3b-282b9db7b866 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:02.280972 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e2864b10-9ce4-4380-bb3b-282b9db7b866 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:02.289142 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e2864b10-9ce4-4380-bb3b-282b9db7b866 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:02.289600 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e2864b10-9ce4-4380-bb3b-282b9db7b866 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:02.290387 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e2864b10-9ce4-4380-bb3b-282b9db7b866 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:02.290874 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e2864b10-9ce4-4380-bb3b-282b9db7b866 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:02.427222 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e2864b10-9ce4-4380-bb3b-282b9db7b866 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:02.437492 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e2864b10-9ce4-4380-bb3b-282b9db7b866 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1677 microversion: 2.1 time: 0.165501 Dec 23 12:06:02.438074 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 419/876] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:06:02 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:06:03.462433 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-dfd7102a-fd0f-490f-9176-7cea4f9049b1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:03.463524 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-dfd7102a-fd0f-490f-9176-7cea4f9049b1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:03.474303 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-dfd7102a-fd0f-490f-9176-7cea4f9049b1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:03.475120 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-dfd7102a-fd0f-490f-9176-7cea4f9049b1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:03.476411 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-dfd7102a-fd0f-490f-9176-7cea4f9049b1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:03.477140 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-dfd7102a-fd0f-490f-9176-7cea4f9049b1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:03.629428 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-dfd7102a-fd0f-490f-9176-7cea4f9049b1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:03.637089 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-dfd7102a-fd0f-490f-9176-7cea4f9049b1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1677 microversion: 2.1 time: 0.181213 Dec 23 12:06:03.637648 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 458/877] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:06:03 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:06:04.658410 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8e063099-63c6-4410-9682-43c0574c3e32 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:04.659402 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-8e063099-63c6-4410-9682-43c0574c3e32 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:04.667304 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8e063099-63c6-4410-9682-43c0574c3e32 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:04.667873 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8e063099-63c6-4410-9682-43c0574c3e32 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:04.668670 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8e063099-63c6-4410-9682-43c0574c3e32 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:04.669097 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8e063099-63c6-4410-9682-43c0574c3e32 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:04.801438 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-8e063099-63c6-4410-9682-43c0574c3e32 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:04.808989 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-8e063099-63c6-4410-9682-43c0574c3e32 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1677 microversion: 2.1 time: 0.156781 Dec 23 12:06:04.809575 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 420/878] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:06:04 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:06:05.830212 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-86943c35-54f9-4015-b321-74eed462abc9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:05.831228 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-86943c35-54f9-4015-b321-74eed462abc9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:05.838713 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-86943c35-54f9-4015-b321-74eed462abc9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:05.839168 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-86943c35-54f9-4015-b321-74eed462abc9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:05.839967 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-86943c35-54f9-4015-b321-74eed462abc9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:05.840398 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-86943c35-54f9-4015-b321-74eed462abc9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:05.988401 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-86943c35-54f9-4015-b321-74eed462abc9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:05.996154 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-86943c35-54f9-4015-b321-74eed462abc9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1677 microversion: 2.1 time: 0.172081 Dec 23 12:06:05.996739 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 459/879] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:06:05 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:06:07.015412 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-35584552-a8ca-424b-bf56-471bc05de88a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:07.016223 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-35584552-a8ca-424b-bf56-471bc05de88a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:07.025158 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-35584552-a8ca-424b-bf56-471bc05de88a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:07.025764 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-35584552-a8ca-424b-bf56-471bc05de88a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:07.026843 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-35584552-a8ca-424b-bf56-471bc05de88a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:07.027418 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-35584552-a8ca-424b-bf56-471bc05de88a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:07.171736 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-35584552-a8ca-424b-bf56-471bc05de88a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:07.179472 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-35584552-a8ca-424b-bf56-471bc05de88a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1677 microversion: 2.1 time: 0.169238 Dec 23 12:06:07.180033 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 421/880] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:06:07 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:06:08.200825 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-653698a9-3ae1-4ea7-9788-ab971c47aeea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:08.201807 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-653698a9-3ae1-4ea7-9788-ab971c47aeea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:08.212576 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-653698a9-3ae1-4ea7-9788-ab971c47aeea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:08.213330 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-653698a9-3ae1-4ea7-9788-ab971c47aeea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:08.214713 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-653698a9-3ae1-4ea7-9788-ab971c47aeea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:08.215486 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-653698a9-3ae1-4ea7-9788-ab971c47aeea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:08.353900 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-653698a9-3ae1-4ea7-9788-ab971c47aeea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:08.362556 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-653698a9-3ae1-4ea7-9788-ab971c47aeea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1677 microversion: 2.1 time: 0.167797 Dec 23 12:06:08.363175 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 460/881] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:06:08 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:06:09.382185 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-14643777-dc90-4610-961e-6e191d81751c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:09.382821 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-14643777-dc90-4610-961e-6e191d81751c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:09.389616 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-14643777-dc90-4610-961e-6e191d81751c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:09.390065 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-14643777-dc90-4610-961e-6e191d81751c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:09.390892 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-14643777-dc90-4610-961e-6e191d81751c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:09.391332 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-14643777-dc90-4610-961e-6e191d81751c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:09.490349 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 23 12:06:09.490598 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: Thu Dec 23 12:06:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac (ip 10.222.0.65) !!! Dec 23 12:06:09.534912 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-14643777-dc90-4610-961e-6e191d81751c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:09.542919 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-14643777-dc90-4610-961e-6e191d81751c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1677 microversion: 2.1 time: 0.165220 Dec 23 12:06:09.543421 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 422/882] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:06:09 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:06:10.561373 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-81e6c6f1-a92b-46ad-9fef-1378e26c14e0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:10.562095 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-81e6c6f1-a92b-46ad-9fef-1378e26c14e0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:10.571057 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-81e6c6f1-a92b-46ad-9fef-1378e26c14e0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:10.571667 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-81e6c6f1-a92b-46ad-9fef-1378e26c14e0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:10.572959 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-81e6c6f1-a92b-46ad-9fef-1378e26c14e0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:10.573640 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-81e6c6f1-a92b-46ad-9fef-1378e26c14e0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:10.711761 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-81e6c6f1-a92b-46ad-9fef-1378e26c14e0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:10.719984 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-81e6c6f1-a92b-46ad-9fef-1378e26c14e0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1677 microversion: 2.1 time: 0.163271 Dec 23 12:06:10.720592 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 461/883] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:06:10 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:06:11.745881 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-851ee2c4-239e-4cd0-8306-a21c5d632ea0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:11.746689 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-851ee2c4-239e-4cd0-8306-a21c5d632ea0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:11.755465 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-851ee2c4-239e-4cd0-8306-a21c5d632ea0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:11.756340 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-851ee2c4-239e-4cd0-8306-a21c5d632ea0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:11.757223 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-851ee2c4-239e-4cd0-8306-a21c5d632ea0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:11.757661 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-851ee2c4-239e-4cd0-8306-a21c5d632ea0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:11.917351 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-851ee2c4-239e-4cd0-8306-a21c5d632ea0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:11.928152 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-851ee2c4-239e-4cd0-8306-a21c5d632ea0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1654 microversion: 2.1 time: 0.187997 Dec 23 12:06:11.928712 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 423/884] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:06:11 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1654 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:06:11.947380 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b22e8d7a-65cd-4166-9220-ec9ff3842297 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:06:11.959251 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b22e8d7a-65cd-4166-9220-ec9ff3842297 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:11.959704 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b22e8d7a-65cd-4166-9220-ec9ff3842297 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:11.990085 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b22e8d7a-65cd-4166-9220-ec9ff3842297 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Going to try to start instance {{(pid=116354) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 23 12:06:12.037810 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b22e8d7a-65cd-4166-9220-ec9ff3842297 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action" status: 202 len: 0 microversion: 2.1 time: 0.095727 Dec 23 12:06:12.038420 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 462/885] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:06:11 2021] POST /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:06:12.046757 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-dd2f1676-b80d-497f-9ebb-c81b59478e0f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:12.047377 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-dd2f1676-b80d-497f-9ebb-c81b59478e0f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:12.053551 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dd2f1676-b80d-497f-9ebb-c81b59478e0f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:12.054080 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dd2f1676-b80d-497f-9ebb-c81b59478e0f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:12.055094 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dd2f1676-b80d-497f-9ebb-c81b59478e0f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:12.055490 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dd2f1676-b80d-497f-9ebb-c81b59478e0f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:12.189822 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-dd2f1676-b80d-497f-9ebb-c81b59478e0f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:12.198125 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-dd2f1676-b80d-497f-9ebb-c81b59478e0f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1663 microversion: 2.1 time: 0.155010 Dec 23 12:06:12.198734 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 424/886] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:06:12 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:06:13.218075 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-72970c48-5613-4578-8539-0d90d643ee81 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:13.218843 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-72970c48-5613-4578-8539-0d90d643ee81 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:13.226159 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-72970c48-5613-4578-8539-0d90d643ee81 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:13.227037 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-72970c48-5613-4578-8539-0d90d643ee81 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:13.227850 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-72970c48-5613-4578-8539-0d90d643ee81 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:13.228291 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-72970c48-5613-4578-8539-0d90d643ee81 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:13.430332 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-72970c48-5613-4578-8539-0d90d643ee81 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:13.440440 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-72970c48-5613-4578-8539-0d90d643ee81 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1663 microversion: 2.1 time: 0.227692 Dec 23 12:06:13.441023 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 463/887] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:06:13 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1663 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:06:14.462191 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ee395926-351a-425c-af0b-d84c8c759969 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:14.463279 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ee395926-351a-425c-af0b-d84c8c759969 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:14.474096 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ee395926-351a-425c-af0b-d84c8c759969 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:14.474870 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ee395926-351a-425c-af0b-d84c8c759969 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:14.476173 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ee395926-351a-425c-af0b-d84c8c759969 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:14.476905 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ee395926-351a-425c-af0b-d84c8c759969 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:14.621236 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ee395926-351a-425c-af0b-d84c8c759969 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:14.628876 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ee395926-351a-425c-af0b-d84c8c759969 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1667 microversion: 2.1 time: 0.172971 Dec 23 12:06:14.629458 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 425/888] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:06:14 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1667 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:06:48.556839 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-955f4286-bee1-4a5a-a25f-20cf67cae222 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:48.557817 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-955f4286-bee1-4a5a-a25f-20cf67cae222 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:48.564421 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-955f4286-bee1-4a5a-a25f-20cf67cae222 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:48.564870 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-955f4286-bee1-4a5a-a25f-20cf67cae222 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:48.565655 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-955f4286-bee1-4a5a-a25f-20cf67cae222 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:48.566088 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-955f4286-bee1-4a5a-a25f-20cf67cae222 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:48.598915 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-955f4286-bee1-4a5a-a25f-20cf67cae222 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046034 Dec 23 12:06:48.599485 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 464/889] 10.222.0.65 () {60 vars in 1342 bytes} [Thu Dec 23 12:06:48 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:06:48.657831 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-eedab120-c0e6-4d1f-921d-54023d759f1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:48.658376 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-eedab120-c0e6-4d1f-921d-54023d759f1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:48.665721 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-eedab120-c0e6-4d1f-921d-54023d759f1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:48.666412 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-eedab120-c0e6-4d1f-921d-54023d759f1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:48.667633 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-eedab120-c0e6-4d1f-921d-54023d759f1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:48.668228 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-eedab120-c0e6-4d1f-921d-54023d759f1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:48.694754 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-eedab120-c0e6-4d1f-921d-54023d759f1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Going to try to terminate instance {{(pid=116355) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:06:48.780952 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-eedab120-c0e6-4d1f-921d-54023d759f1c tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 204 len: 0 microversion: 2.20 time: 0.127254 Dec 23 12:06:48.781569 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 426/890] 10.222.0.65 () {60 vars in 1279 bytes} [Thu Dec 23 12:06:48 2021] DELETE /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 23 12:06:48.790636 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-55223b73-6834-4566-824e-430a9dfc02c4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:48.791427 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-55223b73-6834-4566-824e-430a9dfc02c4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:48.797542 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-55223b73-6834-4566-824e-430a9dfc02c4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:48.798090 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-55223b73-6834-4566-824e-430a9dfc02c4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:48.798910 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-55223b73-6834-4566-824e-430a9dfc02c4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:48.799353 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-55223b73-6834-4566-824e-430a9dfc02c4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:48.936427 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-55223b73-6834-4566-824e-430a9dfc02c4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:48.945475 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-55223b73-6834-4566-824e-430a9dfc02c4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:48.947001 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-55223b73-6834-4566-824e-430a9dfc02c4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:48.948206 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-55223b73-6834-4566-824e-430a9dfc02c4 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1722 microversion: 2.20 time: 0.161998 Dec 23 12:06:48.948748 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 465/891] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:06:48 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:06:49.974474 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5fdddc99-0776-4110-aa1f-6e0c13fa02c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:49.975213 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5fdddc99-0776-4110-aa1f-6e0c13fa02c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:49.981882 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5fdddc99-0776-4110-aa1f-6e0c13fa02c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:49.982335 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5fdddc99-0776-4110-aa1f-6e0c13fa02c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:49.983499 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5fdddc99-0776-4110-aa1f-6e0c13fa02c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:49.983935 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5fdddc99-0776-4110-aa1f-6e0c13fa02c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:50.131119 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-5fdddc99-0776-4110-aa1f-6e0c13fa02c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:50.139768 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-5fdddc99-0776-4110-aa1f-6e0c13fa02c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:50.141314 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-5fdddc99-0776-4110-aa1f-6e0c13fa02c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:50.142737 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5fdddc99-0776-4110-aa1f-6e0c13fa02c6 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1722 microversion: 2.20 time: 0.173743 Dec 23 12:06:50.143491 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 427/892] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:06:49 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:06:51.162426 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f66f60c0-4d53-4a4d-a516-2e5f3558c6b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:51.163155 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f66f60c0-4d53-4a4d-a516-2e5f3558c6b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:51.173010 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f66f60c0-4d53-4a4d-a516-2e5f3558c6b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:51.173564 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f66f60c0-4d53-4a4d-a516-2e5f3558c6b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:51.174358 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f66f60c0-4d53-4a4d-a516-2e5f3558c6b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:51.174824 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f66f60c0-4d53-4a4d-a516-2e5f3558c6b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:51.442723 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f66f60c0-4d53-4a4d-a516-2e5f3558c6b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:51.450564 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f66f60c0-4d53-4a4d-a516-2e5f3558c6b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:51.452057 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-f66f60c0-4d53-4a4d-a516-2e5f3558c6b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:51.453215 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f66f60c0-4d53-4a4d-a516-2e5f3558c6b3 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1722 microversion: 2.20 time: 0.295413 Dec 23 12:06:51.453870 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 466/893] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:06:51 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:06:52.152973 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-1f5d538c-1278-48cb-af82-873905db01cf req-28ddad18-5669-43c1-a93b-cae2ffd5b348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0523247-1eca-4fec-83ea-1496d8dee549", "name": "network-vif-deleted", "tag": "8c8adecf-b23d-4edb-96f6-b1d23075c761"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:06:52.154673 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:06:52.154673 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:06:52.163187 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-1f5d538c-1278-48cb-af82-873905db01cf req-28ddad18-5669-43c1-a93b-cae2ffd5b348 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:52.163641 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-1f5d538c-1278-48cb-af82-873905db01cf req-28ddad18-5669-43c1-a93b-cae2ffd5b348 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:52.174642 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-1f5d538c-1278-48cb-af82-873905db01cf req-28ddad18-5669-43c1-a93b-cae2ffd5b348 service nova] Creating event network-vif-deleted:8c8adecf-b23d-4edb-96f6-b1d23075c761 for instance b0523247-1eca-4fec-83ea-1496d8dee549 on hv-cinder-82282 Dec 23 12:06:52.179236 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-1f5d538c-1278-48cb-af82-873905db01cf req-28ddad18-5669-43c1-a93b-cae2ffd5b348 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029914 Dec 23 12:06:52.180056 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 428/894] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:06:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:06:52.472182 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-cd5e9398-2785-456a-a366-5e0cfb09bb71 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:52.473471 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-cd5e9398-2785-456a-a366-5e0cfb09bb71 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:52.480737 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd5e9398-2785-456a-a366-5e0cfb09bb71 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:52.481190 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd5e9398-2785-456a-a366-5e0cfb09bb71 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:52.482011 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd5e9398-2785-456a-a366-5e0cfb09bb71 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:52.482441 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd5e9398-2785-456a-a366-5e0cfb09bb71 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:52.517674 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd5e9398-2785-456a-a366-5e0cfb09bb71 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:52.518140 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cd5e9398-2785-456a-a366-5e0cfb09bb71 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:52.518727 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-cd5e9398-2785-456a-a366-5e0cfb09bb71 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lazy-loading 'fault' on Instance uuid b0523247-1eca-4fec-83ea-1496d8dee549 {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:06:52.559104 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-cd5e9398-2785-456a-a366-5e0cfb09bb71 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:52.567881 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-cd5e9398-2785-456a-a366-5e0cfb09bb71 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:52.569350 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-cd5e9398-2785-456a-a366-5e0cfb09bb71 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804530daa2704fcdb1fef91615b62c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c655658b5f4f53b4145ea20afcf1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:52.570550 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-cd5e9398-2785-456a-a366-5e0cfb09bb71 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 200 len: 1369 microversion: 2.20 time: 0.102549 Dec 23 12:06:52.571109 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 467/895] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:06:52 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 23 12:06:53.596924 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a42efb07-3278-4179-b7e6-68837fb8675e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:53.598016 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a42efb07-3278-4179-b7e6-68837fb8675e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:53.609081 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a42efb07-3278-4179-b7e6-68837fb8675e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:53.609836 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a42efb07-3278-4179-b7e6-68837fb8675e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:53.611205 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a42efb07-3278-4179-b7e6-68837fb8675e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:53.611643 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a42efb07-3278-4179-b7e6-68837fb8675e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:53.625061 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-a42efb07-3278-4179-b7e6-68837fb8675e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] HTTP exception thrown: Instance b0523247-1eca-4fec-83ea-1496d8dee549 could not be found. Dec 23 12:06:53.625639 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a42efb07-3278-4179-b7e6-68837fb8675e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Returning 404 to user: Instance b0523247-1eca-4fec-83ea-1496d8dee549 could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:06:53.626479 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a42efb07-3278-4179-b7e6-68837fb8675e tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 404 len: 111 microversion: 2.20 time: 0.037708 Dec 23 12:06:53.627083 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 429/896] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:06:53 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 23 12:06:53.635666 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-07c71520-96a0-4bd4-a2a4-15d60a871cbb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '.version_select at 0x7fcf285afc10>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:53.639067 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: ERROR oslo.messaging._drivers.impl_rabbit [None req-07c71520-96a0-4bd4-a2a4-15d60a871cbb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [b388d07f-c7c7-4355-be1e-f770520dc4ad] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 23 12:06:54.652251 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO oslo.messaging._drivers.impl_rabbit [None req-07c71520-96a0-4bd4-a2a4-15d60a871cbb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [b388d07f-c7c7-4355-be1e-f770520dc4ad] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 32862. Dec 23 12:06:54.675671 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-07c71520-96a0-4bd4-a2a4-15d60a871cbb tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-792700626" status: 204 len: 0 microversion: 2.20 time: 1.043662 Dec 23 12:06:54.676239 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 468/897] 10.222.0.65 () {60 vars in 1258 bytes} [Thu Dec 23 12:06:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-792700626 => generated 0 bytes in 1045 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 23 12:06:56.500880 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5ecb4610-c4ad-44f0-8036-a83b9a4babab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:56.501381 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5ecb4610-c4ad-44f0-8036-a83b9a4babab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:56.508018 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5ecb4610-c4ad-44f0-8036-a83b9a4babab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:56.508465 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5ecb4610-c4ad-44f0-8036-a83b9a4babab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:56.509247 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5ecb4610-c4ad-44f0-8036-a83b9a4babab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:56.509676 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5ecb4610-c4ad-44f0-8036-a83b9a4babab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:56.523157 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-5ecb4610-c4ad-44f0-8036-a83b9a4babab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] HTTP exception thrown: Instance b0523247-1eca-4fec-83ea-1496d8dee549 could not be found. Dec 23 12:06:56.523771 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5ecb4610-c4ad-44f0-8036-a83b9a4babab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Returning 404 to user: Instance b0523247-1eca-4fec-83ea-1496d8dee549 could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:06:56.524601 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5ecb4610-c4ad-44f0-8036-a83b9a4babab tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 404 len: 111 microversion: 2.20 time: 0.027439 Dec 23 12:06:56.525110 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 430/898] 10.222.0.65 () {60 vars in 1279 bytes} [Thu Dec 23 12:06:56 2021] DELETE /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 23 12:06:56.533486 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-faa6750d-7dd4-4490-a2ab-6232398cdc2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:56.534156 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-faa6750d-7dd4-4490-a2ab-6232398cdc2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: b0523247-1eca-4fec-83ea-1496d8dee549] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:56.696172 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-faa6750d-7dd4-4490-a2ab-6232398cdc2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:56.696525 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-faa6750d-7dd4-4490-a2ab-6232398cdc2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:56.697307 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-faa6750d-7dd4-4490-a2ab-6232398cdc2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:56.697742 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-faa6750d-7dd4-4490-a2ab-6232398cdc2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:56.711284 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-faa6750d-7dd4-4490-a2ab-6232398cdc2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] HTTP exception thrown: Instance b0523247-1eca-4fec-83ea-1496d8dee549 could not be found. Dec 23 12:06:56.711871 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-faa6750d-7dd4-4490-a2ab-6232398cdc2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Returning 404 to user: Instance b0523247-1eca-4fec-83ea-1496d8dee549 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:06:56.712699 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-faa6750d-7dd4-4490-a2ab-6232398cdc2d tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549" status: 404 len: 111 microversion: 2.20 time: 0.183445 Dec 23 12:06:56.713240 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 469/899] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:06:56 2021] GET /compute/v2.1/servers/b0523247-1eca-4fec-83ea-1496d8dee549 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 23 12:06:57.352532 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-54e58ba0-7bc1-48cd-a8be-10c430bd6e18 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:57.353517 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-54e58ba0-7bc1-48cd-a8be-10c430bd6e18 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:57.362117 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-54e58ba0-7bc1-48cd-a8be-10c430bd6e18 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:57.362588 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-54e58ba0-7bc1-48cd-a8be-10c430bd6e18 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:57.363377 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-54e58ba0-7bc1-48cd-a8be-10c430bd6e18 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:57.363823 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-54e58ba0-7bc1-48cd-a8be-10c430bd6e18 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:57.395192 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-54e58ba0-7bc1-48cd-a8be-10c430bd6e18 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047826 Dec 23 12:06:57.395936 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 431/900] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:06:57 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:06:57.455620 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1a5ed8d9-325d-4201-afcf-6e0e7959bfe4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:57.456111 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1a5ed8d9-325d-4201-afcf-6e0e7959bfe4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:57.462714 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1a5ed8d9-325d-4201-afcf-6e0e7959bfe4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:57.463176 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1a5ed8d9-325d-4201-afcf-6e0e7959bfe4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:57.463958 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1a5ed8d9-325d-4201-afcf-6e0e7959bfe4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:57.464402 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1a5ed8d9-325d-4201-afcf-6e0e7959bfe4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:57.489616 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1a5ed8d9-325d-4201-afcf-6e0e7959bfe4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Going to try to terminate instance {{(pid=116354) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:06:57.573759 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1a5ed8d9-325d-4201-afcf-6e0e7959bfe4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 204 len: 0 microversion: 2.1 time: 0.121582 Dec 23 12:06:57.574717 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 470/901] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:06:57 2021] DELETE /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:06:57.583112 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ce75b282-0e1d-4e9b-ba1a-94ed9b2f610d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:57.583637 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ce75b282-0e1d-4e9b-ba1a-94ed9b2f610d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:57.590144 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ce75b282-0e1d-4e9b-ba1a-94ed9b2f610d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:57.590624 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ce75b282-0e1d-4e9b-ba1a-94ed9b2f610d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:57.591443 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ce75b282-0e1d-4e9b-ba1a-94ed9b2f610d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:57.591900 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ce75b282-0e1d-4e9b-ba1a-94ed9b2f610d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:57.731698 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ce75b282-0e1d-4e9b-ba1a-94ed9b2f610d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:57.743158 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ce75b282-0e1d-4e9b-ba1a-94ed9b2f610d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1673 microversion: 2.1 time: 0.164220 Dec 23 12:06:57.743743 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 432/902] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:06:57 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:06:57.854323 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c3742cd5-54b2-4d13-a926-df7a25c9cfc7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:57.854949 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c3742cd5-54b2-4d13-a926-df7a25c9cfc7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:57.862004 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c3742cd5-54b2-4d13-a926-df7a25c9cfc7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:57.862459 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c3742cd5-54b2-4d13-a926-df7a25c9cfc7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:57.863298 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c3742cd5-54b2-4d13-a926-df7a25c9cfc7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:57.863818 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c3742cd5-54b2-4d13-a926-df7a25c9cfc7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:57.877789 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-c3742cd5-54b2-4d13-a926-df7a25c9cfc7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] HTTP exception thrown: Instance fc998144-5288-467f-82de-9c1983559e40 could not be found. Dec 23 12:06:57.878378 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c3742cd5-54b2-4d13-a926-df7a25c9cfc7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Returning 404 to user: Instance fc998144-5288-467f-82de-9c1983559e40 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:06:57.879407 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c3742cd5-54b2-4d13-a926-df7a25c9cfc7 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "DELETE /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 404 len: 111 microversion: 2.20 time: 0.029136 Dec 23 12:06:57.879815 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 471/903] 10.222.0.65 () {60 vars in 1279 bytes} [Thu Dec 23 12:06:57 2021] DELETE /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 23 12:06:57.891620 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-45379e9d-5601-49cc-b3bf-d719a6d0f455 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:57.892243 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-45379e9d-5601-49cc-b3bf-d719a6d0f455 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] [instance: fc998144-5288-467f-82de-9c1983559e40] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:57.899021 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-45379e9d-5601-49cc-b3bf-d719a6d0f455 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:57.899474 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-45379e9d-5601-49cc-b3bf-d719a6d0f455 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:57.900270 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-45379e9d-5601-49cc-b3bf-d719a6d0f455 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:57.900713 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-45379e9d-5601-49cc-b3bf-d719a6d0f455 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:57.914141 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-45379e9d-5601-49cc-b3bf-d719a6d0f455 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] HTTP exception thrown: Instance fc998144-5288-467f-82de-9c1983559e40 could not be found. Dec 23 12:06:57.914772 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-45379e9d-5601-49cc-b3bf-d719a6d0f455 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] Returning 404 to user: Instance fc998144-5288-467f-82de-9c1983559e40 could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:06:57.915605 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-45379e9d-5601-49cc-b3bf-d719a6d0f455 tempest-AttachVolumeShelveTestJSON-978153387 tempest-AttachVolumeShelveTestJSON-978153387-project] 10.222.0.65 "GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40" status: 404 len: 111 microversion: 2.20 time: 0.029837 Dec 23 12:06:57.916144 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 433/904] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Dec 23 12:06:57 2021] GET /compute/v2.1/servers/fc998144-5288-467f-82de-9c1983559e40 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 23 12:06:58.764431 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-855bb511-2d93-4cc1-8ade-088621d28f4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:06:58.765133 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-855bb511-2d93-4cc1-8ade-088621d28f4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:06:58.772008 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-855bb511-2d93-4cc1-8ade-088621d28f4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:58.772554 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-855bb511-2d93-4cc1-8ade-088621d28f4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:58.773600 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-855bb511-2d93-4cc1-8ade-088621d28f4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:06:58.774200 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-855bb511-2d93-4cc1-8ade-088621d28f4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:06:58.978494 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-855bb511-2d93-4cc1-8ade-088621d28f4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:06:58.986798 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-855bb511-2d93-4cc1-8ade-088621d28f4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1673 microversion: 2.1 time: 0.226179 Dec 23 12:06:58.987656 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 472/905] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:06:58 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1673 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:00.005176 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5863027c-1f4e-4f09-ad43-7704e759baa5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:00.005816 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5863027c-1f4e-4f09-ad43-7704e759baa5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:00.013930 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5863027c-1f4e-4f09-ad43-7704e759baa5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:00.014365 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5863027c-1f4e-4f09-ad43-7704e759baa5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:00.015233 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5863027c-1f4e-4f09-ad43-7704e759baa5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:00.015651 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5863027c-1f4e-4f09-ad43-7704e759baa5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:00.253000 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-5863027c-1f4e-4f09-ad43-7704e759baa5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:00.260905 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5863027c-1f4e-4f09-ad43-7704e759baa5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1673 microversion: 2.1 time: 0.259881 Dec 23 12:07:00.262004 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 434/906] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:06:59 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1673 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:01.278565 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-27c812f4-da39-444c-8f45-d8ab951c314a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:01.279870 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-27c812f4-da39-444c-8f45-d8ab951c314a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:01.286663 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-27c812f4-da39-444c-8f45-d8ab951c314a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:01.287454 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-27c812f4-da39-444c-8f45-d8ab951c314a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:01.288622 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-27c812f4-da39-444c-8f45-d8ab951c314a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:01.289213 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-27c812f4-da39-444c-8f45-d8ab951c314a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:01.524801 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-27c812f4-da39-444c-8f45-d8ab951c314a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:01.536339 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-27c812f4-da39-444c-8f45-d8ab951c314a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 200 len: 1673 microversion: 2.1 time: 0.260778 Dec 23 12:07:01.537664 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 473/907] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:01 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 1673 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:01.897235 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-d5c535c3-7391-4c09-93fe-9ecedd12c57f req-c50ac592-4406-4de8-977d-2fdf94901be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b18df5-9ce3-44cb-8a62-730a959e46ac", "name": "network-vif-deleted", "tag": "e8ea114b-8a29-4d6d-a634-848c94498c32"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:01.898920 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:07:01.898920 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:07:01.907236 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-d5c535c3-7391-4c09-93fe-9ecedd12c57f req-c50ac592-4406-4de8-977d-2fdf94901be6 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:01.907986 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-d5c535c3-7391-4c09-93fe-9ecedd12c57f req-c50ac592-4406-4de8-977d-2fdf94901be6 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:01.919721 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-d5c535c3-7391-4c09-93fe-9ecedd12c57f req-c50ac592-4406-4de8-977d-2fdf94901be6 service nova] Creating event network-vif-deleted:e8ea114b-8a29-4d6d-a634-848c94498c32 for instance f3b18df5-9ce3-44cb-8a62-730a959e46ac on hv-cinder-82282 Dec 23 12:07:01.930086 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-d5c535c3-7391-4c09-93fe-9ecedd12c57f req-c50ac592-4406-4de8-977d-2fdf94901be6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036339 Dec 23 12:07:01.931309 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 435/908] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:07:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:07:02.553617 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7b64f942-2784-4134-a58e-cc920fe18c4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:02.554174 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-7b64f942-2784-4134-a58e-cc920fe18c4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:02.561397 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7b64f942-2784-4134-a58e-cc920fe18c4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:02.562110 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7b64f942-2784-4134-a58e-cc920fe18c4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:02.563087 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7b64f942-2784-4134-a58e-cc920fe18c4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:02.563671 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7b64f942-2784-4134-a58e-cc920fe18c4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:02.580186 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-7b64f942-2784-4134-a58e-cc920fe18c4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] HTTP exception thrown: Instance f3b18df5-9ce3-44cb-8a62-730a959e46ac could not be found. Dec 23 12:07:02.580784 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7b64f942-2784-4134-a58e-cc920fe18c4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Returning 404 to user: Instance f3b18df5-9ce3-44cb-8a62-730a959e46ac could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:07:02.581781 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-7b64f942-2784-4134-a58e-cc920fe18c4c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 404 len: 111 microversion: 2.1 time: 0.032314 Dec 23 12:07:02.582144 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 474/909] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:02 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:07:02.591630 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4e14808c-0f71-4d25-83a6-b10a4a0d12b0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '.version_select at 0x7fcf2862fd30>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:02.615421 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4e14808c-0f71-4d25-83a6-b10a4a0d12b0 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1179936899" status: 202 len: 0 microversion: 2.1 time: 0.027826 Dec 23 12:07:02.616082 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 436/910] 10.222.0.65 () {58 vars in 1220 bytes} [Thu Dec 23 12:07:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1179936899 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:07:02.977059 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a2ed7c2f-5aba-4251-b729-9596fe6a3dfd tempest-VolumesGetTestJSON-648370648 tempest-VolumesGetTestJSON-648370648-project] Action: 'create', calling method: .version_select at 0x7fcf28530040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-705110847", "metadata": {"Type": "work"}}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:03.292455 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a2ed7c2f-5aba-4251-b729-9596fe6a3dfd tempest-VolumesGetTestJSON-648370648 tempest-VolumesGetTestJSON-648370648-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.458132 Dec 23 12:07:03.294470 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 475/911] 10.222.0.65 () {60 vars in 1155 bytes} [Thu Dec 23 12:07:02 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 461 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 23 12:07:03.307873 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-7b9f4eec-081d-4cc3-b5af-3cd9d1d29e6f tempest-VolumesGetTestJSON-648370648 tempest-VolumesGetTestJSON-648370648-project] Calling method '.version_select at 0x7fcf28623ca0>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:03.369878 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-7b9f4eec-081d-4cc3-b5af-3cd9d1d29e6f tempest-VolumesGetTestJSON-648370648 tempest-VolumesGetTestJSON-648370648-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d40519e3-2d83-4e96-a847-90fa449fcecb" status: 200 len: 352 microversion: 2.1 time: 0.067018 Dec 23 12:07:03.370443 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 437/912] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Dec 23 12:07:03 2021] GET /compute/v2.1/os-volumes/d40519e3-2d83-4e96-a847-90fa449fcecb => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:07:03.484840 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8888d506-f8fc-48c8-acb1-7d1f09a24355 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'create', calling method: .version_select at 0x7fcf285fbe50>, body: {"keypair": {"name": "tempest-keypair-1807352179"}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:03.499950 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-8888d506-f8fc-48c8-acb1-7d1f09a24355 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Getting quotas for project 83a1e536ed4249adb353b71e8bf03cfd. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:07:03.503968 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-8888d506-f8fc-48c8-acb1-7d1f09a24355 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Getting quotas for user a351cbc96e894a03906076d2652272a3 and project 83a1e536ed4249adb353b71e8bf03cfd. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:07:03.835219 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-8888d506-f8fc-48c8-acb1-7d1f09a24355 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Getting quotas for project 83a1e536ed4249adb353b71e8bf03cfd. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:07:03.839256 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-8888d506-f8fc-48c8-acb1-7d1f09a24355 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Getting quotas for user a351cbc96e894a03906076d2652272a3 and project 83a1e536ed4249adb353b71e8bf03cfd. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:07:03.853227 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8888d506-f8fc-48c8-acb1-7d1f09a24355 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.372542 Dec 23 12:07:03.853837 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 476/913] 10.222.0.65 () {60 vars in 1157 bytes} [Thu Dec 23 12:07:03 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:04.382781 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d1bfef57-c23a-455e-9abd-e823550104d5 tempest-VolumesGetTestJSON-648370648 tempest-VolumesGetTestJSON-648370648-project] Calling method '.version_select at 0x7fcf284ea8b0>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:04.430031 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d1bfef57-c23a-455e-9abd-e823550104d5 tempest-VolumesGetTestJSON-648370648 tempest-VolumesGetTestJSON-648370648-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d40519e3-2d83-4e96-a847-90fa449fcecb" status: 200 len: 353 microversion: 2.1 time: 0.051574 Dec 23 12:07:04.430630 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 438/914] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Dec 23 12:07:04 2021] GET /compute/v2.1/os-volumes/d40519e3-2d83-4e96-a847-90fa449fcecb => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:07:04.441423 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9f888668-4992-4613-802a-eccb0e38047a tempest-VolumesGetTestJSON-648370648 tempest-VolumesGetTestJSON-648370648-project] Calling method '.version_select at 0x7fcf28530040>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:04.488261 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9f888668-4992-4613-802a-eccb0e38047a tempest-VolumesGetTestJSON-648370648 tempest-VolumesGetTestJSON-648370648-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d40519e3-2d83-4e96-a847-90fa449fcecb" status: 200 len: 353 microversion: 2.1 time: 0.050502 Dec 23 12:07:04.489231 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 477/915] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Dec 23 12:07:04 2021] GET /compute/v2.1/os-volumes/d40519e3-2d83-4e96-a847-90fa449fcecb => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:07:04.505383 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f0224ddf-3716-4b4d-a524-202b639cba10 tempest-VolumesGetTestJSON-648370648 tempest-VolumesGetTestJSON-648370648-project] Calling method '.version_select at 0x7fcf284fbe50>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:04.569259 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f0224ddf-3716-4b4d-a524-202b639cba10 tempest-VolumesGetTestJSON-648370648 tempest-VolumesGetTestJSON-648370648-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/d40519e3-2d83-4e96-a847-90fa449fcecb" status: 202 len: 0 microversion: 2.1 time: 0.067759 Dec 23 12:07:04.569869 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 439/916] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Dec 23 12:07:04 2021] DELETE /compute/v2.1/os-volumes/d40519e3-2d83-4e96-a847-90fa449fcecb => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:07:04.577979 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-fcbb0792-b6ff-4092-90f9-0ddb18829499 tempest-VolumesGetTestJSON-648370648 tempest-VolumesGetTestJSON-648370648-project] Calling method '.version_select at 0x7fcf284d3dc0>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:04.625787 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-fcbb0792-b6ff-4092-90f9-0ddb18829499 tempest-VolumesGetTestJSON-648370648 tempest-VolumesGetTestJSON-648370648-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d40519e3-2d83-4e96-a847-90fa449fcecb" status: 200 len: 352 microversion: 2.1 time: 0.051624 Dec 23 12:07:04.626469 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 478/917] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Dec 23 12:07:04 2021] GET /compute/v2.1/os-volumes/d40519e3-2d83-4e96-a847-90fa449fcecb => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:07:05.160922 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5611f096-a6a0-4b96-90cc-7ccfa5c92715 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-968025662", "imageRef": "938a78c0-341e-4043-927a-9bfe8cf52508", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60b7dd52-a57d-43ce-8b05-529205e80faf"}], "security_groups": [{"name": "tempest-securitygroup--907014330"}], "key_name": "tempest-keypair-1807352179", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:05.265007 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.network.neutron [None req-5611f096-a6a0-4b96-90cc-7ccfa5c92715 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] validate_networks() for [('60b7dd52-a57d-43ce-8b05-529205e80faf', None, None, None, None, None)] {{(pid=116355) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 12:07:05.639228 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-edc94327-e8a5-4f3f-b5dd-324819178a63 tempest-VolumesGetTestJSON-648370648 tempest-VolumesGetTestJSON-648370648-project] Calling method '.version_select at 0x7fcf285c03a0>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:05.668458 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-edc94327-e8a5-4f3f-b5dd-324819178a63 tempest-VolumesGetTestJSON-648370648 tempest-VolumesGetTestJSON-648370648-project] HTTP exception thrown: Volume d40519e3-2d83-4e96-a847-90fa449fcecb could not be found. Dec 23 12:07:05.669061 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-edc94327-e8a5-4f3f-b5dd-324819178a63 tempest-VolumesGetTestJSON-648370648 tempest-VolumesGetTestJSON-648370648-project] Returning 404 to user: Volume d40519e3-2d83-4e96-a847-90fa449fcecb could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:07:05.669886 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-edc94327-e8a5-4f3f-b5dd-324819178a63 tempest-VolumesGetTestJSON-648370648 tempest-VolumesGetTestJSON-648370648-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d40519e3-2d83-4e96-a847-90fa449fcecb" status: 404 len: 109 microversion: 2.1 time: 0.035030 Dec 23 12:07:05.670424 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 479/918] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Dec 23 12:07:05 2021] GET /compute/v2.1/os-volumes/d40519e3-2d83-4e96-a847-90fa449fcecb => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:07:05.746417 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-5611f096-a6a0-4b96-90cc-7ccfa5c92715 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Flavor limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 12:07:05.746952 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-5611f096-a6a0-4b96-90cc-7ccfa5c92715 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Image limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 12:07:05.747361 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-5611f096-a6a0-4b96-90cc-7ccfa5c92715 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Flavor pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 12:07:05.747838 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-5611f096-a6a0-4b96-90cc-7ccfa5c92715 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Image pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 12:07:05.748165 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-5611f096-a6a0-4b96-90cc-7ccfa5c92715 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 12:07:05.757341 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5611f096-a6a0-4b96-90cc-7ccfa5c92715 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:05.757801 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5611f096-a6a0-4b96-90cc-7ccfa5c92715 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:05.758646 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5611f096-a6a0-4b96-90cc-7ccfa5c92715 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:05.759089 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5611f096-a6a0-4b96-90cc-7ccfa5c92715 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:05.776482 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-5611f096-a6a0-4b96-90cc-7ccfa5c92715 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Getting quotas for project 83a1e536ed4249adb353b71e8bf03cfd. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:07:05.780991 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-5611f096-a6a0-4b96-90cc-7ccfa5c92715 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Getting quotas for user a351cbc96e894a03906076d2652272a3 and project 83a1e536ed4249adb353b71e8bf03cfd. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:07:05.793264 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5611f096-a6a0-4b96-90cc-7ccfa5c92715 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Going to run 1 instances... {{(pid=116355) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 12:07:05.795764 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5611f096-a6a0-4b96-90cc-7ccfa5c92715 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='938a78c0-341e-4043-927a-9bfe8cf52508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 12:07:05.843565 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5611f096-a6a0-4b96-90cc-7ccfa5c92715 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.686675 Dec 23 12:07:05.844269 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 440/919] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 12:07:05 2021] POST /compute/v2.1/servers => generated 401 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 12:07:05.853917 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3ab9824d-f7bb-476b-976c-e36b34aa8557 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:05.854824 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3ab9824d-f7bb-476b-976c-e36b34aa8557 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:05.913678 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3ab9824d-f7bb-476b-976c-e36b34aa8557 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:05.920769 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3ab9824d-f7bb-476b-976c-e36b34aa8557 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 200 len: 1237 microversion: 2.1 time: 0.070461 Dec 23 12:07:05.921334 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 480/920] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:05 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:06.939216 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f3500f13-acc2-442f-bac3-6b6b73cd2b7b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:06.939835 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f3500f13-acc2-442f-bac3-6b6b73cd2b7b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:06.948280 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f3500f13-acc2-442f-bac3-6b6b73cd2b7b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:06.948693 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f3500f13-acc2-442f-bac3-6b6b73cd2b7b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:06.949487 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f3500f13-acc2-442f-bac3-6b6b73cd2b7b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:06.949927 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f3500f13-acc2-442f-bac3-6b6b73cd2b7b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:07.016633 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-f3500f13-acc2-442f-bac3-6b6b73cd2b7b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:07.024429 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f3500f13-acc2-442f-bac3-6b6b73cd2b7b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 200 len: 1297 microversion: 2.1 time: 0.090097 Dec 23 12:07:07.025511 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 441/921] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:06 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:08.041797 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-eed0d322-9324-4c98-829b-054b8be09e22 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:08.042395 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-eed0d322-9324-4c98-829b-054b8be09e22 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:08.049791 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-eed0d322-9324-4c98-829b-054b8be09e22 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:08.050244 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-eed0d322-9324-4c98-829b-054b8be09e22 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:08.051128 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-eed0d322-9324-4c98-829b-054b8be09e22 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:08.051572 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-eed0d322-9324-4c98-829b-054b8be09e22 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:08.259408 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-eed0d322-9324-4c98-829b-054b8be09e22 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:08.267937 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-eed0d322-9324-4c98-829b-054b8be09e22 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 200 len: 1362 microversion: 2.1 time: 0.230057 Dec 23 12:07:08.271145 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 481/922] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:08 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:08.583450 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-752f0299-b422-4098-805a-f78ee0e6f3cc req-4fb3314a-5b39-4330-a4a1-7fb324763535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03f128e-f114-443a-adb3-35817870c812", "tag": "114be167-612f-43f6-9558-67fd2fe303ec"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:08.585087 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:07:08.585087 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:07:08.602071 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-752f0299-b422-4098-805a-f78ee0e6f3cc req-4fb3314a-5b39-4330-a4a1-7fb324763535 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:08.603552 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-752f0299-b422-4098-805a-f78ee0e6f3cc req-4fb3314a-5b39-4330-a4a1-7fb324763535 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:08.619800 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-752f0299-b422-4098-805a-f78ee0e6f3cc req-4fb3314a-5b39-4330-a4a1-7fb324763535 service nova] Creating event network-changed:114be167-612f-43f6-9558-67fd2fe303ec for instance c03f128e-f114-443a-adb3-35817870c812 on hv-cinder-82282 Dec 23 12:07:08.625493 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-752f0299-b422-4098-805a-f78ee0e6f3cc req-4fb3314a-5b39-4330-a4a1-7fb324763535 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045315 Dec 23 12:07:08.626799 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 442/923] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:07:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:07:09.286913 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a5d3c537-e8cf-4c56-a91e-8215040ef3fa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:09.288134 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a5d3c537-e8cf-4c56-a91e-8215040ef3fa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:09.300139 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a5d3c537-e8cf-4c56-a91e-8215040ef3fa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:09.300625 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a5d3c537-e8cf-4c56-a91e-8215040ef3fa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:09.301499 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a5d3c537-e8cf-4c56-a91e-8215040ef3fa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:09.302142 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a5d3c537-e8cf-4c56-a91e-8215040ef3fa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:09.547550 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-a5d3c537-e8cf-4c56-a91e-8215040ef3fa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:09.557277 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a5d3c537-e8cf-4c56-a91e-8215040ef3fa tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 200 len: 1362 microversion: 2.1 time: 0.274568 Dec 23 12:07:09.567793 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 482/924] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:09 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:10.173045 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-164150b0-0343-4435-aa2b-6fac63be86c5 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:10.173783 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-164150b0-0343-4435-aa2b-6fac63be86c5 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:10.184503 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-164150b0-0343-4435-aa2b-6fac63be86c5 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:10.185080 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-164150b0-0343-4435-aa2b-6fac63be86c5 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:10.187418 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-164150b0-0343-4435-aa2b-6fac63be86c5 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:10.188891 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-164150b0-0343-4435-aa2b-6fac63be86c5 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:10.236774 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-164150b0-0343-4435-aa2b-6fac63be86c5 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Going to try to terminate instance {{(pid=116355) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:07:10.345691 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-164150b0-0343-4435-aa2b-6fac63be86c5 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 204 len: 0 microversion: 2.1 time: 0.179437 Dec 23 12:07:10.358267 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 443/925] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:07:10 2021] DELETE /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:07:10.364393 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a7740240-c4aa-459c-b3f3-5315c2622087 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:10.365368 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a7740240-c4aa-459c-b3f3-5315c2622087 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:10.371759 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a7740240-c4aa-459c-b3f3-5315c2622087 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:10.372295 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a7740240-c4aa-459c-b3f3-5315c2622087 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:10.373208 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a7740240-c4aa-459c-b3f3-5315c2622087 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:10.373859 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a7740240-c4aa-459c-b3f3-5315c2622087 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:10.531531 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-360e0661-31b9-487e-adb9-33e2f18fe9de req-6bc06d13-9abc-4410-87db-8ec07e9a95ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d087055b-27de-4c01-962a-5744a4c4cd7d", "tag": "ec4101a7-3a3b-4137-ac8f-4d9146a15ac1"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:10.533689 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:07:10.533689 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:07:10.550098 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-360e0661-31b9-487e-adb9-33e2f18fe9de req-6bc06d13-9abc-4410-87db-8ec07e9a95ae service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:10.550482 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-360e0661-31b9-487e-adb9-33e2f18fe9de req-6bc06d13-9abc-4410-87db-8ec07e9a95ae service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:10.565174 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a7740240-c4aa-459c-b3f3-5315c2622087 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:10.569936 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-360e0661-31b9-487e-adb9-33e2f18fe9de req-6bc06d13-9abc-4410-87db-8ec07e9a95ae service nova] Creating event network-changed:ec4101a7-3a3b-4137-ac8f-4d9146a15ac1 for instance d087055b-27de-4c01-962a-5744a4c4cd7d on hv-cinder-82282 Dec 23 12:07:10.573224 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a7740240-c4aa-459c-b3f3-5315c2622087 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1568 microversion: 2.1 time: 0.213256 Dec 23 12:07:10.574017 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 444/926] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:10 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:10.576739 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-360e0661-31b9-487e-adb9-33e2f18fe9de req-6bc06d13-9abc-4410-87db-8ec07e9a95ae service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.401603 Dec 23 12:07:10.578264 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ec4f7b82-0a04-40f2-9c3d-8e66c3d9c585 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:10.579322 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ec4f7b82-0a04-40f2-9c3d-8e66c3d9c585 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:10.580943 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 483/927] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:07:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:07:10.588097 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ec4f7b82-0a04-40f2-9c3d-8e66c3d9c585 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:10.588556 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ec4f7b82-0a04-40f2-9c3d-8e66c3d9c585 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:10.589380 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ec4f7b82-0a04-40f2-9c3d-8e66c3d9c585 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:10.589821 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ec4f7b82-0a04-40f2-9c3d-8e66c3d9c585 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:10.828574 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ec4f7b82-0a04-40f2-9c3d-8e66c3d9c585 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:10.837377 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ec4f7b82-0a04-40f2-9c3d-8e66c3d9c585 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 200 len: 1362 microversion: 2.1 time: 0.262299 Dec 23 12:07:10.838564 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 445/928] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:10 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:11.592341 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a804f767-4dae-4f7e-878d-09ca4aba2bb4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:11.592961 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a804f767-4dae-4f7e-878d-09ca4aba2bb4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:11.601776 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a804f767-4dae-4f7e-878d-09ca4aba2bb4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:11.602237 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a804f767-4dae-4f7e-878d-09ca4aba2bb4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:11.603072 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a804f767-4dae-4f7e-878d-09ca4aba2bb4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:11.603520 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a804f767-4dae-4f7e-878d-09ca4aba2bb4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:11.747240 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-a804f767-4dae-4f7e-878d-09ca4aba2bb4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:11.757466 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a804f767-4dae-4f7e-878d-09ca4aba2bb4 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1450 microversion: 2.1 time: 0.169680 Dec 23 12:07:11.758040 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 484/929] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:11 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:11.858970 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5a379904-1307-4b79-bfa3-45c4d2443dd6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:11.859822 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5a379904-1307-4b79-bfa3-45c4d2443dd6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:11.870581 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5a379904-1307-4b79-bfa3-45c4d2443dd6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:11.871346 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5a379904-1307-4b79-bfa3-45c4d2443dd6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:11.872637 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5a379904-1307-4b79-bfa3-45c4d2443dd6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:11.873374 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5a379904-1307-4b79-bfa3-45c4d2443dd6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:12.014028 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-5a379904-1307-4b79-bfa3-45c4d2443dd6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:12.024059 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5a379904-1307-4b79-bfa3-45c4d2443dd6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 200 len: 1362 microversion: 2.1 time: 0.171783 Dec 23 12:07:12.024609 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 446/930] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:11 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:12.342453 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-826343be-75d4-4848-bdd0-24049e6d3cd0 req-3228a2ec-bf73-4d56-8bf0-ceedf6873055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03f128e-f114-443a-adb3-35817870c812", "name": "network-vif-plugged", "status": "completed", "tag": "114be167-612f-43f6-9558-67fd2fe303ec"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:12.344304 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:07:12.344304 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:07:12.351943 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-826343be-75d4-4848-bdd0-24049e6d3cd0 req-3228a2ec-bf73-4d56-8bf0-ceedf6873055 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:12.352840 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-826343be-75d4-4848-bdd0-24049e6d3cd0 req-3228a2ec-bf73-4d56-8bf0-ceedf6873055 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:12.365542 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-826343be-75d4-4848-bdd0-24049e6d3cd0 req-3228a2ec-bf73-4d56-8bf0-ceedf6873055 service nova] Creating event network-vif-plugged:114be167-612f-43f6-9558-67fd2fe303ec for instance c03f128e-f114-443a-adb3-35817870c812 on hv-cinder-82282 Dec 23 12:07:12.370358 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-826343be-75d4-4848-bdd0-24049e6d3cd0 req-3228a2ec-bf73-4d56-8bf0-ceedf6873055 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031589 Dec 23 12:07:12.371010 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 485/931] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:07:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:07:12.776221 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d7bd8668-ccf5-4843-9c27-16fe8d0e57c2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:12.777042 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d7bd8668-ccf5-4843-9c27-16fe8d0e57c2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:12.784350 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d7bd8668-ccf5-4843-9c27-16fe8d0e57c2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:12.784878 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d7bd8668-ccf5-4843-9c27-16fe8d0e57c2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:12.786277 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d7bd8668-ccf5-4843-9c27-16fe8d0e57c2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:12.787383 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d7bd8668-ccf5-4843-9c27-16fe8d0e57c2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:13.043749 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1f2a0962-62c6-4c7a-87e9-694dcead1e36 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:13.044801 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1f2a0962-62c6-4c7a-87e9-694dcead1e36 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:13.053248 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1f2a0962-62c6-4c7a-87e9-694dcead1e36 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:13.053793 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1f2a0962-62c6-4c7a-87e9-694dcead1e36 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:13.054840 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1f2a0962-62c6-4c7a-87e9-694dcead1e36 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:13.055255 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1f2a0962-62c6-4c7a-87e9-694dcead1e36 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:13.056688 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d7bd8668-ccf5-4843-9c27-16fe8d0e57c2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:13.065227 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d7bd8668-ccf5-4843-9c27-16fe8d0e57c2 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1450 microversion: 2.1 time: 0.294116 Dec 23 12:07:13.065799 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 447/932] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:12 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1450 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:13.278985 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1f2a0962-62c6-4c7a-87e9-694dcead1e36 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:13.293291 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1f2a0962-62c6-4c7a-87e9-694dcead1e36 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 200 len: 1362 microversion: 2.1 time: 0.255507 Dec 23 12:07:13.293874 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 486/933] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:13 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:13.438879 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-c7a0c62c-3b47-4df7-ab1b-be6b31131799 req-ff875e36-65ea-4081-8396-6dc580870b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d087055b-27de-4c01-962a-5744a4c4cd7d", "name": "network-vif-deleted", "tag": "ec4101a7-3a3b-4137-ac8f-4d9146a15ac1"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:13.441345 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:07:13.441345 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:07:13.449973 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-c7a0c62c-3b47-4df7-ab1b-be6b31131799 req-ff875e36-65ea-4081-8396-6dc580870b2d service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:13.450310 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-c7a0c62c-3b47-4df7-ab1b-be6b31131799 req-ff875e36-65ea-4081-8396-6dc580870b2d service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:13.463209 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-c7a0c62c-3b47-4df7-ab1b-be6b31131799 req-ff875e36-65ea-4081-8396-6dc580870b2d service nova] Creating event network-vif-deleted:ec4101a7-3a3b-4137-ac8f-4d9146a15ac1 for instance d087055b-27de-4c01-962a-5744a4c4cd7d on hv-cinder-82282 Dec 23 12:07:13.468587 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-c7a0c62c-3b47-4df7-ab1b-be6b31131799 req-ff875e36-65ea-4081-8396-6dc580870b2d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033167 Dec 23 12:07:13.470715 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 448/934] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:07:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:07:14.082213 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-aa833260-f897-46e7-a539-aa7220b3af79 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:14.082837 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-aa833260-f897-46e7-a539-aa7220b3af79 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:14.090314 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aa833260-f897-46e7-a539-aa7220b3af79 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:14.091094 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aa833260-f897-46e7-a539-aa7220b3af79 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:14.091868 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aa833260-f897-46e7-a539-aa7220b3af79 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:14.092442 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aa833260-f897-46e7-a539-aa7220b3af79 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:14.124922 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aa833260-f897-46e7-a539-aa7220b3af79 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:14.125369 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aa833260-f897-46e7-a539-aa7220b3af79 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:14.125809 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-aa833260-f897-46e7-a539-aa7220b3af79 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lazy-loading 'fault' on Instance uuid d087055b-27de-4c01-962a-5744a4c4cd7d {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:07:14.165859 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-aa833260-f897-46e7-a539-aa7220b3af79 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d641a1c7e09494d86fe4a3bb88a6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78243e9c4ec4d51a07e39bec8a14073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:14.173804 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-aa833260-f897-46e7-a539-aa7220b3af79 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 200 len: 1224 microversion: 2.1 time: 0.095317 Dec 23 12:07:14.174355 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 487/935] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:14 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:14.311355 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-47866072-f608-4845-8467-1225992cfca2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:14.312019 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-47866072-f608-4845-8467-1225992cfca2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:14.319790 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-47866072-f608-4845-8467-1225992cfca2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:14.320302 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-47866072-f608-4845-8467-1225992cfca2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:14.321098 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-47866072-f608-4845-8467-1225992cfca2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:14.322131 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-47866072-f608-4845-8467-1225992cfca2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:14.484530 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-47866072-f608-4845-8467-1225992cfca2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:14.493722 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-47866072-f608-4845-8467-1225992cfca2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 200 len: 1362 microversion: 2.1 time: 0.187004 Dec 23 12:07:14.494370 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 449/936] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:14 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:15.191722 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-511605ee-e5c8-478a-b9ce-bc5d4f35146a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:15.192343 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-511605ee-e5c8-478a-b9ce-bc5d4f35146a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] [instance: d087055b-27de-4c01-962a-5744a4c4cd7d] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:15.198991 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-511605ee-e5c8-478a-b9ce-bc5d4f35146a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:15.199460 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-511605ee-e5c8-478a-b9ce-bc5d4f35146a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:15.200237 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-511605ee-e5c8-478a-b9ce-bc5d4f35146a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:15.200680 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-511605ee-e5c8-478a-b9ce-bc5d4f35146a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:15.214978 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-511605ee-e5c8-478a-b9ce-bc5d4f35146a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] HTTP exception thrown: Instance d087055b-27de-4c01-962a-5744a4c4cd7d could not be found. Dec 23 12:07:15.215720 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-511605ee-e5c8-478a-b9ce-bc5d4f35146a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Returning 404 to user: Instance d087055b-27de-4c01-962a-5744a4c4cd7d could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:07:15.216645 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-511605ee-e5c8-478a-b9ce-bc5d4f35146a tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d" status: 404 len: 111 microversion: 2.1 time: 0.028735 Dec 23 12:07:15.217210 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 488/937] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:15 2021] GET /compute/v2.1/servers/d087055b-27de-4c01-962a-5744a4c4cd7d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:07:15.384255 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2828ea99-7eef-48ec-ad3d-f4cc3b331935 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] Calling method '.version_select at 0x7fcf2862fd30>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:15.403679 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2828ea99-7eef-48ec-ad3d-f4cc3b331935 tempest-TestShelveInstance-1605506839 tempest-TestShelveInstance-1605506839-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1304321284" status: 202 len: 0 microversion: 2.1 time: 0.023180 Dec 23 12:07:15.404944 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 450/938] 10.222.0.65 () {58 vars in 1253 bytes} [Thu Dec 23 12:07:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1304321284 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:07:15.513444 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-38023f95-ee50-4dbd-9a83-9f642fc99aea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:15.514118 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-38023f95-ee50-4dbd-9a83-9f642fc99aea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:15.521788 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-38023f95-ee50-4dbd-9a83-9f642fc99aea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:15.522368 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-38023f95-ee50-4dbd-9a83-9f642fc99aea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:15.523358 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-38023f95-ee50-4dbd-9a83-9f642fc99aea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:15.524018 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-38023f95-ee50-4dbd-9a83-9f642fc99aea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:15.661965 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-38023f95-ee50-4dbd-9a83-9f642fc99aea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:15.669618 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-38023f95-ee50-4dbd-9a83-9f642fc99aea tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 200 len: 1548 microversion: 2.1 time: 0.160816 Dec 23 12:07:15.670496 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 489/939] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:15 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:15.685741 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-29d49a66-ab97-44ca-a1f0-6755c6f67379 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:15.686233 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-29d49a66-ab97-44ca-a1f0-6755c6f67379 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:15.693825 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-29d49a66-ab97-44ca-a1f0-6755c6f67379 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:15.694434 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-29d49a66-ab97-44ca-a1f0-6755c6f67379 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:15.695110 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-29d49a66-ab97-44ca-a1f0-6755c6f67379 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:15.695759 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-29d49a66-ab97-44ca-a1f0-6755c6f67379 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:15.783107 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-29d49a66-ab97-44ca-a1f0-6755c6f67379 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100879 Dec 23 12:07:15.783958 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 451/940] 10.222.0.65 () {58 vars in 1274 bytes} [Thu Dec 23 12:07:15 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:07:16.825623 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5d4000a5-ff65-4733-b08d-75712052833f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:16.826787 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5d4000a5-ff65-4733-b08d-75712052833f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:16.830876 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-45daa0f2-e580-4189-831d-ab07385b7924 req-01456856-e3cc-44e8-9433-31d79afa40ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03f128e-f114-443a-adb3-35817870c812", "tag": "114be167-612f-43f6-9558-67fd2fe303ec"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:16.832367 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:07:16.832367 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:07:16.839241 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5d4000a5-ff65-4733-b08d-75712052833f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:16.840002 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-45daa0f2-e580-4189-831d-ab07385b7924 req-01456856-e3cc-44e8-9433-31d79afa40ce service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:16.840451 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-45daa0f2-e580-4189-831d-ab07385b7924 req-01456856-e3cc-44e8-9433-31d79afa40ce service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:16.840825 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5d4000a5-ff65-4733-b08d-75712052833f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:16.841740 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5d4000a5-ff65-4733-b08d-75712052833f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:16.842597 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5d4000a5-ff65-4733-b08d-75712052833f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:16.854743 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-45daa0f2-e580-4189-831d-ab07385b7924 req-01456856-e3cc-44e8-9433-31d79afa40ce service nova] Creating event network-changed:114be167-612f-43f6-9558-67fd2fe303ec for instance c03f128e-f114-443a-adb3-35817870c812 on hv-cinder-82282 Dec 23 12:07:16.861890 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-45daa0f2-e580-4189-831d-ab07385b7924 req-01456856-e3cc-44e8-9433-31d79afa40ce service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035507 Dec 23 12:07:16.863078 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 452/941] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:07:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:07:16.978630 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5d4000a5-ff65-4733-b08d-75712052833f tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 14 microversion: 2.1 time: 0.160385 Dec 23 12:07:16.979881 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 490/942] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:16 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:07:17.992041 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d8d24ca5-ecc6-46f5-9a53-f11ac6306cdc tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:17.993453 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d8d24ca5-ecc6-46f5-9a53-f11ac6306cdc tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:18.000947 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d8d24ca5-ecc6-46f5-9a53-f11ac6306cdc tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:18.001701 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d8d24ca5-ecc6-46f5-9a53-f11ac6306cdc tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:18.002500 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d8d24ca5-ecc6-46f5-9a53-f11ac6306cdc tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:18.003120 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d8d24ca5-ecc6-46f5-9a53-f11ac6306cdc tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:18.122010 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d8d24ca5-ecc6-46f5-9a53-f11ac6306cdc tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 14 microversion: 2.1 time: 0.134936 Dec 23 12:07:18.132495 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 453/943] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:17 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:07:19.141858 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-fb0baca0-33e6-4d39-9172-13ed3a470c74 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:19.143049 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-fb0baca0-33e6-4d39-9172-13ed3a470c74 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:19.150429 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fb0baca0-33e6-4d39-9172-13ed3a470c74 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:19.151333 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fb0baca0-33e6-4d39-9172-13ed3a470c74 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:19.152394 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fb0baca0-33e6-4d39-9172-13ed3a470c74 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:19.153061 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fb0baca0-33e6-4d39-9172-13ed3a470c74 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:19.260902 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-fb0baca0-33e6-4d39-9172-13ed3a470c74 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 14 microversion: 2.1 time: 0.122997 Dec 23 12:07:19.261772 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 491/944] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:19 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:07:20.273160 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-08eab34c-7192-4c38-ac29-0ac40451f983 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:20.274195 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-08eab34c-7192-4c38-ac29-0ac40451f983 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:20.281714 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-08eab34c-7192-4c38-ac29-0ac40451f983 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:20.282170 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-08eab34c-7192-4c38-ac29-0ac40451f983 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:20.283011 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-08eab34c-7192-4c38-ac29-0ac40451f983 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:20.283449 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-08eab34c-7192-4c38-ac29-0ac40451f983 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:20.400626 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-08eab34c-7192-4c38-ac29-0ac40451f983 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 14 microversion: 2.1 time: 0.131570 Dec 23 12:07:20.401254 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 454/945] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:20 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:07:21.415002 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ef019464-8c4e-4e0c-b96f-4be2fef268b8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:21.416676 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ef019464-8c4e-4e0c-b96f-4be2fef268b8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:21.424356 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ef019464-8c4e-4e0c-b96f-4be2fef268b8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:21.425148 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ef019464-8c4e-4e0c-b96f-4be2fef268b8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:21.426107 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ef019464-8c4e-4e0c-b96f-4be2fef268b8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:21.426749 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ef019464-8c4e-4e0c-b96f-4be2fef268b8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:21.548282 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ef019464-8c4e-4e0c-b96f-4be2fef268b8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 14 microversion: 2.1 time: 0.137498 Dec 23 12:07:21.550047 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 492/946] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:21 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:07:22.561093 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-875c548a-8398-4dd3-bc3d-7cab222c7b56 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:22.562232 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-875c548a-8398-4dd3-bc3d-7cab222c7b56 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:22.573656 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-875c548a-8398-4dd3-bc3d-7cab222c7b56 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:22.578391 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-875c548a-8398-4dd3-bc3d-7cab222c7b56 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:22.579325 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-875c548a-8398-4dd3-bc3d-7cab222c7b56 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:22.580267 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-875c548a-8398-4dd3-bc3d-7cab222c7b56 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:22.697952 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-875c548a-8398-4dd3-bc3d-7cab222c7b56 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 14 microversion: 2.1 time: 0.140677 Dec 23 12:07:22.699116 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 455/947] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:22 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:07:23.710362 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-98238740-69f5-443f-b978-3fa7d291b913 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:23.711510 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-98238740-69f5-443f-b978-3fa7d291b913 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:23.718850 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-98238740-69f5-443f-b978-3fa7d291b913 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:23.719329 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-98238740-69f5-443f-b978-3fa7d291b913 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:23.720125 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-98238740-69f5-443f-b978-3fa7d291b913 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:23.720562 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-98238740-69f5-443f-b978-3fa7d291b913 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:23.811268 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-98238740-69f5-443f-b978-3fa7d291b913 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 14 microversion: 2.1 time: 0.105451 Dec 23 12:07:23.812849 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 493/948] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:23 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:07:24.828220 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-9886ce45-4f48-40bb-b4e1-8cb87caffce7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:24.829902 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-9886ce45-4f48-40bb-b4e1-8cb87caffce7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:24.838544 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9886ce45-4f48-40bb-b4e1-8cb87caffce7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:24.839028 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9886ce45-4f48-40bb-b4e1-8cb87caffce7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:24.839826 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9886ce45-4f48-40bb-b4e1-8cb87caffce7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:24.840263 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9886ce45-4f48-40bb-b4e1-8cb87caffce7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:24.944456 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-9886ce45-4f48-40bb-b4e1-8cb87caffce7 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 14 microversion: 2.1 time: 0.123108 Dec 23 12:07:24.945076 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 456/949] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:24 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:07:25.064832 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5e6fd377-af81-4e68-a309-8d0d03a9e4a8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1450342304", "imageRef": "938a78c0-341e-4043-927a-9bfe8cf52508", "flavorRef": "452"}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:25.120150 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.network.neutron [None req-5e6fd377-af81-4e68-a309-8d0d03a9e4a8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] validate_networks() for None {{(pid=116354) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 12:07:25.399483 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-5e6fd377-af81-4e68-a309-8d0d03a9e4a8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Flavor limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 12:07:25.399907 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-5e6fd377-af81-4e68-a309-8d0d03a9e4a8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Image limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 12:07:25.400387 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-5e6fd377-af81-4e68-a309-8d0d03a9e4a8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Flavor pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 12:07:25.400789 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-5e6fd377-af81-4e68-a309-8d0d03a9e4a8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Image pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 12:07:25.401196 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-5e6fd377-af81-4e68-a309-8d0d03a9e4a8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 12:07:25.410476 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5e6fd377-af81-4e68-a309-8d0d03a9e4a8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:25.410962 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5e6fd377-af81-4e68-a309-8d0d03a9e4a8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:25.412422 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5e6fd377-af81-4e68-a309-8d0d03a9e4a8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:25.412871 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5e6fd377-af81-4e68-a309-8d0d03a9e4a8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:25.429483 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-5e6fd377-af81-4e68-a309-8d0d03a9e4a8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Getting quotas for project 50d3ff105cb54863ad70a88885dea51f. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:07:25.433607 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-5e6fd377-af81-4e68-a309-8d0d03a9e4a8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Getting quotas for user d9c2eff497f842a2b3d67788af8e6ea9 and project 50d3ff105cb54863ad70a88885dea51f. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:07:25.445043 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5e6fd377-af81-4e68-a309-8d0d03a9e4a8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Going to run 1 instances... {{(pid=116354) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 12:07:25.447436 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5e6fd377-af81-4e68-a309-8d0d03a9e4a8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='938a78c0-341e-4043-927a-9bfe8cf52508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 12:07:25.493607 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5e6fd377-af81-4e68-a309-8d0d03a9e4a8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.432940 Dec 23 12:07:25.494477 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 494/950] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 12:07:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 12:07:25.504808 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-97287b74-92a6-4989-b974-059d932b581b tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:25.505844 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-97287b74-92a6-4989-b974-059d932b581b tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:25.560582 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-97287b74-92a6-4989-b974-059d932b581b tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c2eff497f842a2b3d67788af8e6ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d3ff105cb54863ad70a88885dea51f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:25.567363 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-97287b74-92a6-4989-b974-059d932b581b tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f" status: 200 len: 1215 microversion: 2.1 time: 0.066625 Dec 23 12:07:25.567982 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 457/951] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:25 2021] GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:25.956738 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-aaede67f-88a1-45dd-950a-a20ad11387f9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:25.957745 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-aaede67f-88a1-45dd-950a-a20ad11387f9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:25.966530 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aaede67f-88a1-45dd-950a-a20ad11387f9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:25.966993 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aaede67f-88a1-45dd-950a-a20ad11387f9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:25.967789 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aaede67f-88a1-45dd-950a-a20ad11387f9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:25.968230 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aaede67f-88a1-45dd-950a-a20ad11387f9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:26.107708 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-aaede67f-88a1-45dd-950a-a20ad11387f9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 14 microversion: 2.1 time: 0.154302 Dec 23 12:07:26.110852 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 495/952] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:25 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:07:26.585874 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c7cc8a2e-f90e-4805-bd32-d6ffcbca7a62 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:26.586663 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c7cc8a2e-f90e-4805-bd32-d6ffcbca7a62 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:26.595283 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c7cc8a2e-f90e-4805-bd32-d6ffcbca7a62 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:26.595819 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c7cc8a2e-f90e-4805-bd32-d6ffcbca7a62 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:26.596729 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c7cc8a2e-f90e-4805-bd32-d6ffcbca7a62 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:26.597244 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c7cc8a2e-f90e-4805-bd32-d6ffcbca7a62 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:26.659128 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c7cc8a2e-f90e-4805-bd32-d6ffcbca7a62 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c2eff497f842a2b3d67788af8e6ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d3ff105cb54863ad70a88885dea51f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:26.666523 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c7cc8a2e-f90e-4805-bd32-d6ffcbca7a62 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f" status: 200 len: 1267 microversion: 2.1 time: 0.085146 Dec 23 12:07:26.667107 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 458/953] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:26 2021] GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:27.119383 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ae9960e0-b619-4b6b-ae5e-d89ee31e77af tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:27.120463 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ae9960e0-b619-4b6b-ae5e-d89ee31e77af tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:27.127855 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ae9960e0-b619-4b6b-ae5e-d89ee31e77af tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:27.128505 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ae9960e0-b619-4b6b-ae5e-d89ee31e77af tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:27.129490 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ae9960e0-b619-4b6b-ae5e-d89ee31e77af tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:27.130110 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ae9960e0-b619-4b6b-ae5e-d89ee31e77af tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:27.225120 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ae9960e0-b619-4b6b-ae5e-d89ee31e77af tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 14 microversion: 2.1 time: 0.109777 Dec 23 12:07:27.225785 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 496/954] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:27 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:07:27.684057 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-bbd1d5ea-8e94-439d-a7bc-97110c786e4c tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:27.684764 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-bbd1d5ea-8e94-439d-a7bc-97110c786e4c tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:27.692157 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bbd1d5ea-8e94-439d-a7bc-97110c786e4c tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:27.692844 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bbd1d5ea-8e94-439d-a7bc-97110c786e4c tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:27.694003 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bbd1d5ea-8e94-439d-a7bc-97110c786e4c tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:27.694460 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bbd1d5ea-8e94-439d-a7bc-97110c786e4c tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:27.931535 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-bbd1d5ea-8e94-439d-a7bc-97110c786e4c tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c2eff497f842a2b3d67788af8e6ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d3ff105cb54863ad70a88885dea51f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:27.939271 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-bbd1d5ea-8e94-439d-a7bc-97110c786e4c tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f" status: 200 len: 1315 microversion: 2.1 time: 0.259037 Dec 23 12:07:27.939838 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 459/955] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:27 2021] GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:28.236201 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3ca68046-c118-4458-97cc-54871371afce tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:28.236462 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-1c89de8b-785c-40b5-989f-95e3c929b94a req-dd69184d-0211-4fc8-8633-5d7793463052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f", "tag": "e727dc66-3893-43d3-a307-d0db39294e1b"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:28.237980 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3ca68046-c118-4458-97cc-54871371afce tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:28.238152 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:07:28.238152 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:07:28.250197 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-1c89de8b-785c-40b5-989f-95e3c929b94a req-dd69184d-0211-4fc8-8633-5d7793463052 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:28.250637 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3ca68046-c118-4458-97cc-54871371afce tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:28.251287 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3ca68046-c118-4458-97cc-54871371afce tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:28.251466 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-1c89de8b-785c-40b5-989f-95e3c929b94a req-dd69184d-0211-4fc8-8633-5d7793463052 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:28.252238 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3ca68046-c118-4458-97cc-54871371afce tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:28.252671 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3ca68046-c118-4458-97cc-54871371afce tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:28.263521 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-1c89de8b-785c-40b5-989f-95e3c929b94a req-dd69184d-0211-4fc8-8633-5d7793463052 service nova] Creating event network-changed:e727dc66-3893-43d3-a307-d0db39294e1b for instance e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f on hv-cinder-82282 Dec 23 12:07:28.268569 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-1c89de8b-785c-40b5-989f-95e3c929b94a req-dd69184d-0211-4fc8-8633-5d7793463052 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036855 Dec 23 12:07:28.269466 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 497/956] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:07:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 12:07:28.403408 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3ca68046-c118-4458-97cc-54871371afce tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 8992 microversion: 2.1 time: 0.170868 Dec 23 12:07:28.404091 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 460/957] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:28 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 8992 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:07:28.958091 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-bfc9ef6c-4692-46b4-9f7b-96e2a9e61ef8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:28.958820 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-bfc9ef6c-4692-46b4-9f7b-96e2a9e61ef8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:28.965486 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-bfc9ef6c-4692-46b4-9f7b-96e2a9e61ef8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:28.966079 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-bfc9ef6c-4692-46b4-9f7b-96e2a9e61ef8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:28.966763 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-bfc9ef6c-4692-46b4-9f7b-96e2a9e61ef8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:28.967241 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-bfc9ef6c-4692-46b4-9f7b-96e2a9e61ef8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:29.207811 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-bfc9ef6c-4692-46b4-9f7b-96e2a9e61ef8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c2eff497f842a2b3d67788af8e6ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d3ff105cb54863ad70a88885dea51f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:29.216163 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-bfc9ef6c-4692-46b4-9f7b-96e2a9e61ef8 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f" status: 200 len: 1315 microversion: 2.1 time: 0.262639 Dec 23 12:07:29.216747 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 498/958] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:28 2021] GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:29.414694 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-be5facb3-aa34-4eb5-890b-2437d8dc6b4d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:29.415723 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-be5facb3-aa34-4eb5-890b-2437d8dc6b4d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:29.424717 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-be5facb3-aa34-4eb5-890b-2437d8dc6b4d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:29.425136 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-be5facb3-aa34-4eb5-890b-2437d8dc6b4d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:29.425956 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-be5facb3-aa34-4eb5-890b-2437d8dc6b4d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:29.426384 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-be5facb3-aa34-4eb5-890b-2437d8dc6b4d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:29.547456 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-be5facb3-aa34-4eb5-890b-2437d8dc6b4d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 15025 microversion: 2.1 time: 0.136709 Dec 23 12:07:29.548229 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 461/959] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:29 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 15025 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:30.239432 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3eed290a-8410-4a36-8f02-a829f0ca1c47 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:30.240430 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3eed290a-8410-4a36-8f02-a829f0ca1c47 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:30.252174 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3eed290a-8410-4a36-8f02-a829f0ca1c47 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:30.252940 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3eed290a-8410-4a36-8f02-a829f0ca1c47 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:30.254256 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3eed290a-8410-4a36-8f02-a829f0ca1c47 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:30.255032 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3eed290a-8410-4a36-8f02-a829f0ca1c47 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:30.407111 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3eed290a-8410-4a36-8f02-a829f0ca1c47 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c2eff497f842a2b3d67788af8e6ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d3ff105cb54863ad70a88885dea51f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:30.417009 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3eed290a-8410-4a36-8f02-a829f0ca1c47 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f" status: 200 len: 1315 microversion: 2.1 time: 0.186136 Dec 23 12:07:30.417550 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 499/960] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:30 2021] GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:30.564346 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a95b1c0f-5872-47ef-9c18-139cbe42d224 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:30.565983 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a95b1c0f-5872-47ef-9c18-139cbe42d224 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:30.574840 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a95b1c0f-5872-47ef-9c18-139cbe42d224 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:30.575296 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a95b1c0f-5872-47ef-9c18-139cbe42d224 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:30.576082 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a95b1c0f-5872-47ef-9c18-139cbe42d224 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:30.576520 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a95b1c0f-5872-47ef-9c18-139cbe42d224 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:30.703048 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a95b1c0f-5872-47ef-9c18-139cbe42d224 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 18208 microversion: 2.1 time: 0.145037 Dec 23 12:07:30.704091 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 462/961] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:30 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 18208 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:31.435039 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5f4d8ca0-f4a8-4f59-9eed-396fef06b0f2 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:31.435624 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5f4d8ca0-f4a8-4f59-9eed-396fef06b0f2 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:31.442074 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5f4d8ca0-f4a8-4f59-9eed-396fef06b0f2 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:31.442536 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5f4d8ca0-f4a8-4f59-9eed-396fef06b0f2 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:31.443351 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5f4d8ca0-f4a8-4f59-9eed-396fef06b0f2 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:31.443784 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5f4d8ca0-f4a8-4f59-9eed-396fef06b0f2 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:31.593316 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-5f4d8ca0-f4a8-4f59-9eed-396fef06b0f2 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c2eff497f842a2b3d67788af8e6ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d3ff105cb54863ad70a88885dea51f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:31.601483 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5f4d8ca0-f4a8-4f59-9eed-396fef06b0f2 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f" status: 200 len: 1315 microversion: 2.1 time: 0.170401 Dec 23 12:07:31.602052 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 500/962] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:31 2021] GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:31.722121 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3349606f-ad61-4cc9-9ecc-348f51d93ef2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:31.723693 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3349606f-ad61-4cc9-9ecc-348f51d93ef2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:31.733063 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3349606f-ad61-4cc9-9ecc-348f51d93ef2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:31.733527 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3349606f-ad61-4cc9-9ecc-348f51d93ef2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:31.734302 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3349606f-ad61-4cc9-9ecc-348f51d93ef2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:31.734779 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3349606f-ad61-4cc9-9ecc-348f51d93ef2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:31.854071 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3349606f-ad61-4cc9-9ecc-348f51d93ef2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 19342 microversion: 2.1 time: 0.138609 Dec 23 12:07:31.854923 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 463/963] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:31 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 19342 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:32.623068 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ab8fe44d-6dab-4c78-9298-feba3873fffe tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:32.624097 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ab8fe44d-6dab-4c78-9298-feba3873fffe tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:32.634999 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ab8fe44d-6dab-4c78-9298-feba3873fffe tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:32.635691 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ab8fe44d-6dab-4c78-9298-feba3873fffe tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:32.636501 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ab8fe44d-6dab-4c78-9298-feba3873fffe tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:32.636944 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ab8fe44d-6dab-4c78-9298-feba3873fffe tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:32.776369 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ab8fe44d-6dab-4c78-9298-feba3873fffe tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c2eff497f842a2b3d67788af8e6ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d3ff105cb54863ad70a88885dea51f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:32.783918 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ab8fe44d-6dab-4c78-9298-feba3873fffe tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f" status: 200 len: 1315 microversion: 2.1 time: 0.167367 Dec 23 12:07:32.784460 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 501/964] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:32 2021] GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:32.867917 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-440213d5-ae53-474b-aeda-70480307b268 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:32.869182 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-440213d5-ae53-474b-aeda-70480307b268 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:32.876057 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-440213d5-ae53-474b-aeda-70480307b268 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:32.876516 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-440213d5-ae53-474b-aeda-70480307b268 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:32.877308 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-440213d5-ae53-474b-aeda-70480307b268 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:32.877744 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-440213d5-ae53-474b-aeda-70480307b268 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:32.987387 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-440213d5-ae53-474b-aeda-70480307b268 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 22015 microversion: 2.1 time: 0.123374 Dec 23 12:07:32.988087 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 464/965] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:32 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 22015 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:33.800940 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3cb4148e-dbfb-4a4d-9c3a-20205c1b9301 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:33.801580 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3cb4148e-dbfb-4a4d-9c3a-20205c1b9301 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:33.808873 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3cb4148e-dbfb-4a4d-9c3a-20205c1b9301 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:33.809328 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3cb4148e-dbfb-4a4d-9c3a-20205c1b9301 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:33.810113 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3cb4148e-dbfb-4a4d-9c3a-20205c1b9301 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:33.810540 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3cb4148e-dbfb-4a4d-9c3a-20205c1b9301 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:33.961162 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3cb4148e-dbfb-4a4d-9c3a-20205c1b9301 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c2eff497f842a2b3d67788af8e6ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d3ff105cb54863ad70a88885dea51f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:33.968990 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3cb4148e-dbfb-4a4d-9c3a-20205c1b9301 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f" status: 200 len: 1315 microversion: 2.1 time: 0.171786 Dec 23 12:07:33.969536 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 502/966] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:33 2021] GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:34.000091 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a628d3f6-417c-4f38-9078-d27b3eb5c5a9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:34.001123 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a628d3f6-417c-4f38-9078-d27b3eb5c5a9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:34.008111 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a628d3f6-417c-4f38-9078-d27b3eb5c5a9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:34.008556 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a628d3f6-417c-4f38-9078-d27b3eb5c5a9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:34.009456 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a628d3f6-417c-4f38-9078-d27b3eb5c5a9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:34.009885 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a628d3f6-417c-4f38-9078-d27b3eb5c5a9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:34.122214 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a628d3f6-417c-4f38-9078-d27b3eb5c5a9 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 23229 microversion: 2.1 time: 0.125633 Dec 23 12:07:34.123284 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 465/967] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:33 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 23229 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:34.484611 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-f7cfe385-f876-48d4-b45c-56b070dd4970 req-c15d838a-6137-44db-a250-4bedcd27c0bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f", "name": "network-vif-plugged", "status": "completed", "tag": "e727dc66-3893-43d3-a307-d0db39294e1b"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:34.486145 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:07:34.486145 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:07:34.493690 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-f7cfe385-f876-48d4-b45c-56b070dd4970 req-c15d838a-6137-44db-a250-4bedcd27c0bb service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:34.494172 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-f7cfe385-f876-48d4-b45c-56b070dd4970 req-c15d838a-6137-44db-a250-4bedcd27c0bb service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:34.505544 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-f7cfe385-f876-48d4-b45c-56b070dd4970 req-c15d838a-6137-44db-a250-4bedcd27c0bb service nova] Creating event network-vif-plugged:e727dc66-3893-43d3-a307-d0db39294e1b for instance e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f on hv-cinder-82282 Dec 23 12:07:34.510849 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-f7cfe385-f876-48d4-b45c-56b070dd4970 req-c15d838a-6137-44db-a250-4bedcd27c0bb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030262 Dec 23 12:07:34.511449 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 503/968] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:07:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:07:34.991332 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d17ccbeb-4488-41cd-991b-b19bbffc110a tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:34.992489 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d17ccbeb-4488-41cd-991b-b19bbffc110a tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:35.004497 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d17ccbeb-4488-41cd-991b-b19bbffc110a tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:35.005539 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d17ccbeb-4488-41cd-991b-b19bbffc110a tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:35.006478 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d17ccbeb-4488-41cd-991b-b19bbffc110a tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:35.007241 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d17ccbeb-4488-41cd-991b-b19bbffc110a tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:35.137541 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-773533ec-5708-4dc6-ad38-fc7e0907070e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:35.139648 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-773533ec-5708-4dc6-ad38-fc7e0907070e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:35.146198 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-773533ec-5708-4dc6-ad38-fc7e0907070e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:35.146788 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-773533ec-5708-4dc6-ad38-fc7e0907070e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:35.147658 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-773533ec-5708-4dc6-ad38-fc7e0907070e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:35.148472 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-773533ec-5708-4dc6-ad38-fc7e0907070e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:35.156547 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d17ccbeb-4488-41cd-991b-b19bbffc110a tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c2eff497f842a2b3d67788af8e6ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d3ff105cb54863ad70a88885dea51f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:35.164377 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d17ccbeb-4488-41cd-991b-b19bbffc110a tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f" status: 200 len: 1315 microversion: 2.1 time: 0.179951 Dec 23 12:07:35.165157 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 466/969] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:34 2021] GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:35.309058 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-773533ec-5708-4dc6-ad38-fc7e0907070e tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 24662 microversion: 2.1 time: 0.175877 Dec 23 12:07:35.309843 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 504/970] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:35 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 24662 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:36.183921 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-02ad72cb-85a5-45d5-b02a-cd9bc9df0afd tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:36.184494 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-02ad72cb-85a5-45d5-b02a-cd9bc9df0afd tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:36.191132 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-02ad72cb-85a5-45d5-b02a-cd9bc9df0afd tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:36.191593 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-02ad72cb-85a5-45d5-b02a-cd9bc9df0afd tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:36.192367 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-02ad72cb-85a5-45d5-b02a-cd9bc9df0afd tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:36.192806 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-02ad72cb-85a5-45d5-b02a-cd9bc9df0afd tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:36.322932 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-721d8ebc-e7e9-4f1a-a26d-aa37f14353e4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:36.324062 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-721d8ebc-e7e9-4f1a-a26d-aa37f14353e4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:36.328609 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-02ad72cb-85a5-45d5-b02a-cd9bc9df0afd tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c2eff497f842a2b3d67788af8e6ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d3ff105cb54863ad70a88885dea51f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:36.331025 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-721d8ebc-e7e9-4f1a-a26d-aa37f14353e4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:36.331548 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-721d8ebc-e7e9-4f1a-a26d-aa37f14353e4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:36.332401 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-721d8ebc-e7e9-4f1a-a26d-aa37f14353e4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:36.332836 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-721d8ebc-e7e9-4f1a-a26d-aa37f14353e4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:36.335839 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-02ad72cb-85a5-45d5-b02a-cd9bc9df0afd tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f" status: 200 len: 1315 microversion: 2.1 time: 0.157110 Dec 23 12:07:36.337104 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 467/971] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:36 2021] GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:36.463683 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-721d8ebc-e7e9-4f1a-a26d-aa37f14353e4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 25708 microversion: 2.1 time: 0.144989 Dec 23 12:07:36.464706 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 505/972] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:36 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 25708 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 23 12:07:37.357968 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5d9a6493-47da-46ba-810a-9c9dedc0fa7f tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:37.358984 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5d9a6493-47da-46ba-810a-9c9dedc0fa7f tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:37.369544 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5d9a6493-47da-46ba-810a-9c9dedc0fa7f tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:37.369988 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5d9a6493-47da-46ba-810a-9c9dedc0fa7f tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:37.370829 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5d9a6493-47da-46ba-810a-9c9dedc0fa7f tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:37.371262 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5d9a6493-47da-46ba-810a-9c9dedc0fa7f tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:37.478767 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8a95d4f7-bf3f-4feb-adfd-7f709efbc9f1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:37.479817 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8a95d4f7-bf3f-4feb-adfd-7f709efbc9f1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:37.487776 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8a95d4f7-bf3f-4feb-adfd-7f709efbc9f1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:37.488311 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8a95d4f7-bf3f-4feb-adfd-7f709efbc9f1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:37.489105 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8a95d4f7-bf3f-4feb-adfd-7f709efbc9f1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:37.489539 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8a95d4f7-bf3f-4feb-adfd-7f709efbc9f1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:37.518541 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-5d9a6493-47da-46ba-810a-9c9dedc0fa7f tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c2eff497f842a2b3d67788af8e6ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d3ff105cb54863ad70a88885dea51f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:37.526784 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5d9a6493-47da-46ba-810a-9c9dedc0fa7f tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f" status: 200 len: 1465 microversion: 2.1 time: 0.175901 Dec 23 12:07:37.527367 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 468/973] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:37 2021] GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f => generated 1465 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:37.564854 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-1d4daa77-f70d-4fa9-97fd-236578be8035 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:37.565395 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-1d4daa77-f70d-4fa9-97fd-236578be8035 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:37.574284 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1d4daa77-f70d-4fa9-97fd-236578be8035 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:37.574850 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1d4daa77-f70d-4fa9-97fd-236578be8035 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:37.575938 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1d4daa77-f70d-4fa9-97fd-236578be8035 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:37.576640 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1d4daa77-f70d-4fa9-97fd-236578be8035 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:37.604672 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-1d4daa77-f70d-4fa9-97fd-236578be8035 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Going to try to terminate instance {{(pid=116355) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:07:37.615912 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8a95d4f7-bf3f-4feb-adfd-7f709efbc9f1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 26717 microversion: 2.1 time: 0.141347 Dec 23 12:07:37.616818 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 506/974] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:37 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 26717 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:37.681493 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-1d4daa77-f70d-4fa9-97fd-236578be8035 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f" status: 204 len: 0 microversion: 2.1 time: 0.119867 Dec 23 12:07:37.682084 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 469/975] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:07:37 2021] DELETE /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:07:37.691013 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7b9f413a-cb8e-4422-acc6-9c82d401b961 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:37.691822 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-7b9f413a-cb8e-4422-acc6-9c82d401b961 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:37.699228 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7b9f413a-cb8e-4422-acc6-9c82d401b961 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:37.699684 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7b9f413a-cb8e-4422-acc6-9c82d401b961 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:37.700481 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7b9f413a-cb8e-4422-acc6-9c82d401b961 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:37.700923 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7b9f413a-cb8e-4422-acc6-9c82d401b961 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:37.852359 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-7b9f413a-cb8e-4422-acc6-9c82d401b961 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c2eff497f842a2b3d67788af8e6ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d3ff105cb54863ad70a88885dea51f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:37.865075 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-7b9f413a-cb8e-4422-acc6-9c82d401b961 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f" status: 200 len: 1471 microversion: 2.1 time: 0.178194 Dec 23 12:07:37.865918 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 507/976] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:37 2021] GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:38.628597 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-6f1d7a84-e15d-4aa5-b100-d51cb29312d6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:38.629549 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-6f1d7a84-e15d-4aa5-b100-d51cb29312d6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:38.636100 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6f1d7a84-e15d-4aa5-b100-d51cb29312d6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:38.636553 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6f1d7a84-e15d-4aa5-b100-d51cb29312d6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:38.637330 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6f1d7a84-e15d-4aa5-b100-d51cb29312d6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:38.637793 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6f1d7a84-e15d-4aa5-b100-d51cb29312d6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:38.768553 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-6f1d7a84-e15d-4aa5-b100-d51cb29312d6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 27384 microversion: 2.1 time: 0.143620 Dec 23 12:07:38.769580 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 470/977] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:38 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 27384 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:38.884010 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1dab72e4-8e83-4e68-8465-012ed2ba05a7 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:38.884565 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1dab72e4-8e83-4e68-8465-012ed2ba05a7 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:38.891543 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1dab72e4-8e83-4e68-8465-012ed2ba05a7 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:38.891997 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1dab72e4-8e83-4e68-8465-012ed2ba05a7 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:38.892779 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1dab72e4-8e83-4e68-8465-012ed2ba05a7 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:38.893222 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1dab72e4-8e83-4e68-8465-012ed2ba05a7 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:39.039038 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1dab72e4-8e83-4e68-8465-012ed2ba05a7 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c2eff497f842a2b3d67788af8e6ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d3ff105cb54863ad70a88885dea51f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:39.047367 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1dab72e4-8e83-4e68-8465-012ed2ba05a7 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f" status: 200 len: 1471 microversion: 2.1 time: 0.167146 Dec 23 12:07:39.047941 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 508/978] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:38 2021] GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:39.784106 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-296a0d29-9596-43ac-ac52-5871e89b7b9c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:39.785200 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-296a0d29-9596-43ac-ac52-5871e89b7b9c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:39.792584 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-296a0d29-9596-43ac-ac52-5871e89b7b9c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:39.793042 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-296a0d29-9596-43ac-ac52-5871e89b7b9c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:39.793828 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-296a0d29-9596-43ac-ac52-5871e89b7b9c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:39.794263 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-296a0d29-9596-43ac-ac52-5871e89b7b9c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:39.939847 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-296a0d29-9596-43ac-ac52-5871e89b7b9c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 27717 microversion: 2.1 time: 0.159291 Dec 23 12:07:39.940849 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 471/979] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:39 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 27717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:40.068871 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8d07425c-a9ee-49fb-a30e-19ed367779fd tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:40.069820 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8d07425c-a9ee-49fb-a30e-19ed367779fd tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:40.080773 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d07425c-a9ee-49fb-a30e-19ed367779fd tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:40.081501 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d07425c-a9ee-49fb-a30e-19ed367779fd tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:40.082909 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d07425c-a9ee-49fb-a30e-19ed367779fd tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:40.083646 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d07425c-a9ee-49fb-a30e-19ed367779fd tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:40.284854 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8d07425c-a9ee-49fb-a30e-19ed367779fd tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c2eff497f842a2b3d67788af8e6ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d3ff105cb54863ad70a88885dea51f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:07:40.292873 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8d07425c-a9ee-49fb-a30e-19ed367779fd tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f" status: 200 len: 1471 microversion: 2.1 time: 0.230047 Dec 23 12:07:40.293548 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 509/980] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:40 2021] GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f => generated 1471 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:40.617397 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-266ae07a-f9e2-4a41-a34f-33ba9d1758c3 req-4450fe0c-e991-4e71-9208-cce88fe1f8bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f", "name": "network-vif-deleted", "tag": "e727dc66-3893-43d3-a307-d0db39294e1b"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:40.618864 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:07:40.618864 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:07:40.627753 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-266ae07a-f9e2-4a41-a34f-33ba9d1758c3 req-4450fe0c-e991-4e71-9208-cce88fe1f8bc service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:40.628172 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-266ae07a-f9e2-4a41-a34f-33ba9d1758c3 req-4450fe0c-e991-4e71-9208-cce88fe1f8bc service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:40.641568 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-266ae07a-f9e2-4a41-a34f-33ba9d1758c3 req-4450fe0c-e991-4e71-9208-cce88fe1f8bc service nova] Creating event network-vif-deleted:e727dc66-3893-43d3-a307-d0db39294e1b for instance e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f on hv-cinder-82282 Dec 23 12:07:40.646663 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-266ae07a-f9e2-4a41-a34f-33ba9d1758c3 req-4450fe0c-e991-4e71-9208-cce88fe1f8bc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033259 Dec 23 12:07:40.647455 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 472/981] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:07:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:07:40.957612 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-dd2bc06c-2403-426e-b4b4-5863151ba8ce tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:40.959127 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-dd2bc06c-2403-426e-b4b4-5863151ba8ce tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:40.967843 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-dd2bc06c-2403-426e-b4b4-5863151ba8ce tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:40.968296 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-dd2bc06c-2403-426e-b4b4-5863151ba8ce tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:40.969066 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-dd2bc06c-2403-426e-b4b4-5863151ba8ce tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:40.969501 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-dd2bc06c-2403-426e-b4b4-5863151ba8ce tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:41.093565 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-dd2bc06c-2403-426e-b4b4-5863151ba8ce tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 28010 microversion: 2.1 time: 0.141760 Dec 23 12:07:41.094761 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 510/982] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:40 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 28010 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:41.312908 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-aebf866b-4596-498b-a52e-53e37791cc68 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:07:41.313604 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-aebf866b-4596-498b-a52e-53e37791cc68 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] [instance: e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:41.320146 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aebf866b-4596-498b-a52e-53e37791cc68 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:41.320720 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aebf866b-4596-498b-a52e-53e37791cc68 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:41.321570 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aebf866b-4596-498b-a52e-53e37791cc68 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:41.322225 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aebf866b-4596-498b-a52e-53e37791cc68 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:41.339817 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-aebf866b-4596-498b-a52e-53e37791cc68 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] HTTP exception thrown: Instance e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f could not be found. Dec 23 12:07:41.340400 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-aebf866b-4596-498b-a52e-53e37791cc68 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] Returning 404 to user: Instance e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:07:41.341227 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-aebf866b-4596-498b-a52e-53e37791cc68 tempest-VolumesNegativeTest-584837017 tempest-VolumesNegativeTest-584837017-project] 10.222.0.65 "GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f" status: 404 len: 111 microversion: 2.1 time: 0.035125 Dec 23 12:07:41.341766 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 473/983] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:07:41 2021] GET /compute/v2.1/servers/e8cd7d5f-ef6b-4ac8-a515-b9d8cfd29e8f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:07:42.109171 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8bfa59be-dc7b-4e77-82e2-3a18b8e6a3b5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:42.110033 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8bfa59be-dc7b-4e77-82e2-3a18b8e6a3b5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:42.117426 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8bfa59be-dc7b-4e77-82e2-3a18b8e6a3b5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:42.117884 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8bfa59be-dc7b-4e77-82e2-3a18b8e6a3b5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:42.118717 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8bfa59be-dc7b-4e77-82e2-3a18b8e6a3b5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:42.119159 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8bfa59be-dc7b-4e77-82e2-3a18b8e6a3b5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:42.242550 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8bfa59be-dc7b-4e77-82e2-3a18b8e6a3b5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 28197 microversion: 2.1 time: 0.137677 Dec 23 12:07:42.243467 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 511/984] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:42 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 28197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:43.254122 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a396b8d2-361f-4487-bc5d-56277e8de999 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:43.255082 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a396b8d2-361f-4487-bc5d-56277e8de999 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:43.261697 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a396b8d2-361f-4487-bc5d-56277e8de999 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:43.262149 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a396b8d2-361f-4487-bc5d-56277e8de999 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:43.263159 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a396b8d2-361f-4487-bc5d-56277e8de999 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:43.263597 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a396b8d2-361f-4487-bc5d-56277e8de999 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:43.361705 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a396b8d2-361f-4487-bc5d-56277e8de999 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 28197 microversion: 2.1 time: 0.110910 Dec 23 12:07:43.362342 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 474/985] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:43 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 28197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:44.374207 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b237c8c3-6714-4a6c-8aab-4abc8403128c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:44.375343 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b237c8c3-6714-4a6c-8aab-4abc8403128c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:44.382398 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b237c8c3-6714-4a6c-8aab-4abc8403128c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:44.382877 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b237c8c3-6714-4a6c-8aab-4abc8403128c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:44.383663 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b237c8c3-6714-4a6c-8aab-4abc8403128c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:44.384095 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b237c8c3-6714-4a6c-8aab-4abc8403128c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:44.500811 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b237c8c3-6714-4a6c-8aab-4abc8403128c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 28488 microversion: 2.1 time: 0.130279 Dec 23 12:07:44.501552 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 512/986] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:44 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 28488 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:45.513962 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-66c09d7a-f2de-432b-a071-88fb02a78f90 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:45.515131 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-66c09d7a-f2de-432b-a071-88fb02a78f90 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:45.522328 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-66c09d7a-f2de-432b-a071-88fb02a78f90 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:45.522887 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-66c09d7a-f2de-432b-a071-88fb02a78f90 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:45.523676 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-66c09d7a-f2de-432b-a071-88fb02a78f90 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:45.524118 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-66c09d7a-f2de-432b-a071-88fb02a78f90 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:45.637536 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-66c09d7a-f2de-432b-a071-88fb02a78f90 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 28656 microversion: 2.1 time: 0.127430 Dec 23 12:07:45.638781 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 475/987] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:45 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 28656 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:46.649938 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1071c37f-93ad-4f22-ad58-1f28f1d7ed26 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:46.651094 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1071c37f-93ad-4f22-ad58-1f28f1d7ed26 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:46.658416 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1071c37f-93ad-4f22-ad58-1f28f1d7ed26 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:46.659060 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1071c37f-93ad-4f22-ad58-1f28f1d7ed26 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:46.659690 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1071c37f-93ad-4f22-ad58-1f28f1d7ed26 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:46.660164 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1071c37f-93ad-4f22-ad58-1f28f1d7ed26 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:46.774147 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1071c37f-93ad-4f22-ad58-1f28f1d7ed26 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 28656 microversion: 2.1 time: 0.128200 Dec 23 12:07:46.775083 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 513/988] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:46 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 28656 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:47.790435 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c8919137-9a96-40c9-b336-1e75b6df8ca6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:47.793827 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c8919137-9a96-40c9-b336-1e75b6df8ca6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:47.805129 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c8919137-9a96-40c9-b336-1e75b6df8ca6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:47.806109 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c8919137-9a96-40c9-b336-1e75b6df8ca6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:47.813045 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c8919137-9a96-40c9-b336-1e75b6df8ca6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:47.814073 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c8919137-9a96-40c9-b336-1e75b6df8ca6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:47.920237 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c8919137-9a96-40c9-b336-1e75b6df8ca6 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 28656 microversion: 2.1 time: 0.138126 Dec 23 12:07:47.920893 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 476/989] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:47 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 28656 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:48.934973 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-82f97241-f5ac-417a-88b6-a164095f5605 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:48.937526 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-82f97241-f5ac-417a-88b6-a164095f5605 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:48.959437 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-82f97241-f5ac-417a-88b6-a164095f5605 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:48.960102 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-82f97241-f5ac-417a-88b6-a164095f5605 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:48.961107 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-82f97241-f5ac-417a-88b6-a164095f5605 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:48.961703 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-82f97241-f5ac-417a-88b6-a164095f5605 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:49.102173 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-82f97241-f5ac-417a-88b6-a164095f5605 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 28656 microversion: 2.1 time: 0.172009 Dec 23 12:07:49.106131 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 514/990] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:48 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 28656 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:50.114503 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-9601c37b-ab16-4978-95e5-9ba9caf322ca tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:50.115639 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-9601c37b-ab16-4978-95e5-9ba9caf322ca tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:50.148534 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9601c37b-ab16-4978-95e5-9ba9caf322ca tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:50.148995 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9601c37b-ab16-4978-95e5-9ba9caf322ca tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:50.150730 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9601c37b-ab16-4978-95e5-9ba9caf322ca tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:50.151173 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9601c37b-ab16-4978-95e5-9ba9caf322ca tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:50.281927 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-9601c37b-ab16-4978-95e5-9ba9caf322ca tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 30172 microversion: 2.1 time: 0.171521 Dec 23 12:07:50.282600 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 477/991] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:50 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 30172 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:51.298593 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7ddffa62-a60b-4749-a288-9dda0446f676 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:51.299705 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-7ddffa62-a60b-4749-a288-9dda0446f676 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:51.309106 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7ddffa62-a60b-4749-a288-9dda0446f676 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:51.309812 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7ddffa62-a60b-4749-a288-9dda0446f676 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:51.311049 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7ddffa62-a60b-4749-a288-9dda0446f676 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:51.311655 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7ddffa62-a60b-4749-a288-9dda0446f676 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:51.430471 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-7ddffa62-a60b-4749-a288-9dda0446f676 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 31873 microversion: 2.1 time: 0.140283 Dec 23 12:07:51.431274 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 515/992] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:51 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 31873 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:52.444877 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c08c8961-9c46-49fb-8175-5f5ebfd00e22 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:52.447387 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c08c8961-9c46-49fb-8175-5f5ebfd00e22 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:52.457487 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c08c8961-9c46-49fb-8175-5f5ebfd00e22 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:52.458378 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c08c8961-9c46-49fb-8175-5f5ebfd00e22 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:52.460101 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c08c8961-9c46-49fb-8175-5f5ebfd00e22 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:52.460925 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c08c8961-9c46-49fb-8175-5f5ebfd00e22 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:52.584268 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c08c8961-9c46-49fb-8175-5f5ebfd00e22 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 33213 microversion: 2.1 time: 0.144796 Dec 23 12:07:52.588959 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 478/993] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:52 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 33213 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 23 12:07:53.598275 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f6f87cc0-dfa2-4e19-9918-8ab531fdbb8d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:53.599393 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-f6f87cc0-dfa2-4e19-9918-8ab531fdbb8d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:53.615876 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f6f87cc0-dfa2-4e19-9918-8ab531fdbb8d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:53.616468 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f6f87cc0-dfa2-4e19-9918-8ab531fdbb8d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:53.617616 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f6f87cc0-dfa2-4e19-9918-8ab531fdbb8d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:53.618199 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-f6f87cc0-dfa2-4e19-9918-8ab531fdbb8d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:53.740677 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f6f87cc0-dfa2-4e19-9918-8ab531fdbb8d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 34021 microversion: 2.1 time: 0.146811 Dec 23 12:07:53.741733 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 516/994] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:53 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 34021 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:54.754100 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-60970f67-547a-41ac-a96e-0cb829640c46 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:54.755781 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-60970f67-547a-41ac-a96e-0cb829640c46 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:54.763600 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-60970f67-547a-41ac-a96e-0cb829640c46 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:54.764482 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-60970f67-547a-41ac-a96e-0cb829640c46 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:54.765330 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-60970f67-547a-41ac-a96e-0cb829640c46 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:54.766059 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-60970f67-547a-41ac-a96e-0cb829640c46 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:54.888476 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-60970f67-547a-41ac-a96e-0cb829640c46 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 35096 microversion: 2.1 time: 0.138237 Dec 23 12:07:54.889118 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 479/995] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:54 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 35096 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:55.676802 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-bb054b4f-53e2-430f-9c8e-bd19477daf6c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Action: 'create', calling method: .version_select at 0x7fcf28602f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2138957045"}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:55.692153 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-bb054b4f-53e2-430f-9c8e-bd19477daf6c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Getting quotas for project 65754771daec4e08922a4c10f20ca653. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:07:55.696388 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-bb054b4f-53e2-430f-9c8e-bd19477daf6c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Getting quotas for user 28fb997ba3e94ce4a7cff5d5efe7d4b2 and project 65754771daec4e08922a4c10f20ca653. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:07:55.901398 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2e8b16d1-2773-4149-ac1c-8d1d43ce22e8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:55.902336 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2e8b16d1-2773-4149-ac1c-8d1d43ce22e8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:55.909568 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2e8b16d1-2773-4149-ac1c-8d1d43ce22e8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:55.910026 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2e8b16d1-2773-4149-ac1c-8d1d43ce22e8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:55.910846 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2e8b16d1-2773-4149-ac1c-8d1d43ce22e8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:55.911289 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2e8b16d1-2773-4149-ac1c-8d1d43ce22e8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:55.995907 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-bb054b4f-53e2-430f-9c8e-bd19477daf6c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Getting quotas for project 65754771daec4e08922a4c10f20ca653. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:07:55.999881 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-bb054b4f-53e2-430f-9c8e-bd19477daf6c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Getting quotas for user 28fb997ba3e94ce4a7cff5d5efe7d4b2 and project 65754771daec4e08922a4c10f20ca653. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:07:56.013376 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-bb054b4f-53e2-430f-9c8e-bd19477daf6c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.507206 Dec 23 12:07:56.013973 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 517/996] 10.222.0.65 () {60 vars in 1157 bytes} [Thu Dec 23 12:07:55 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:07:56.023532 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2e8b16d1-2773-4149-ac1c-8d1d43ce22e8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 36419 microversion: 2.1 time: 0.126236 Dec 23 12:07:56.024178 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 480/997] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:55 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 36419 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:57.036029 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9e23842e-f6e9-4665-afc0-31f15b34914a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:57.037024 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9e23842e-f6e9-4665-afc0-31f15b34914a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:57.044663 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9e23842e-f6e9-4665-afc0-31f15b34914a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:57.045334 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9e23842e-f6e9-4665-afc0-31f15b34914a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:57.046297 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9e23842e-f6e9-4665-afc0-31f15b34914a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:57.046767 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9e23842e-f6e9-4665-afc0-31f15b34914a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:57.163844 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9e23842e-f6e9-4665-afc0-31f15b34914a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 37671 microversion: 2.1 time: 0.132128 Dec 23 12:07:57.168781 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 518/998] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:57 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 37671 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:58.177158 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4024d276-a227-49e4-b2cf-796a44a9229c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:58.178242 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4024d276-a227-49e4-b2cf-796a44a9229c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:58.186645 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4024d276-a227-49e4-b2cf-796a44a9229c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:58.188006 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4024d276-a227-49e4-b2cf-796a44a9229c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:58.190553 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4024d276-a227-49e4-b2cf-796a44a9229c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:58.190896 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4024d276-a227-49e4-b2cf-796a44a9229c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:58.324249 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4024d276-a227-49e4-b2cf-796a44a9229c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 38186 microversion: 2.1 time: 0.151308 Dec 23 12:07:58.327597 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 481/999] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:58 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 38186 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:07:59.339222 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b6465c0c-afb2-4dba-a2db-3a3439c40470 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:07:59.340233 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b6465c0c-afb2-4dba-a2db-3a3439c40470 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:07:59.352151 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b6465c0c-afb2-4dba-a2db-3a3439c40470 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:59.352621 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b6465c0c-afb2-4dba-a2db-3a3439c40470 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:59.353423 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b6465c0c-afb2-4dba-a2db-3a3439c40470 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:07:59.353868 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b6465c0c-afb2-4dba-a2db-3a3439c40470 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:07:59.472908 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b6465c0c-afb2-4dba-a2db-3a3439c40470 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 38186 microversion: 2.1 time: 0.137656 Dec 23 12:07:59.473569 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 519/1000] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:07:59 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 38186 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:08:00.489908 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-7f6f4177-c66d-44ef-9e40-a88ecde3dcc1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:08:00.491322 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-7f6f4177-c66d-44ef-9e40-a88ecde3dcc1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:00.500758 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7f6f4177-c66d-44ef-9e40-a88ecde3dcc1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:00.501070 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7f6f4177-c66d-44ef-9e40-a88ecde3dcc1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:00.501847 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7f6f4177-c66d-44ef-9e40-a88ecde3dcc1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:00.502280 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7f6f4177-c66d-44ef-9e40-a88ecde3dcc1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:00.621799 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-7f6f4177-c66d-44ef-9e40-a88ecde3dcc1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 38186 microversion: 2.1 time: 0.137474 Dec 23 12:08:00.622543 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 482/1001] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:08:00 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 38186 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:08:01.636082 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9b1f7136-89ed-49a7-9727-380be7909d89 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:08:01.637812 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9b1f7136-89ed-49a7-9727-380be7909d89 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:01.646224 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9b1f7136-89ed-49a7-9727-380be7909d89 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:01.646907 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9b1f7136-89ed-49a7-9727-380be7909d89 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:01.647723 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9b1f7136-89ed-49a7-9727-380be7909d89 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:01.648164 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9b1f7136-89ed-49a7-9727-380be7909d89 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:01.764440 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9b1f7136-89ed-49a7-9727-380be7909d89 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action" status: 200 len: 38315 microversion: 2.1 time: 0.132709 Dec 23 12:08:01.765148 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 520/1002] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:08:01 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/action => generated 38315 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 23 12:08:01.775698 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-83ef6146-dada-4e61-90cf-74c55cf46618 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:01.776242 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-83ef6146-dada-4e61-90cf-74c55cf46618 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:01.783963 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-83ef6146-dada-4e61-90cf-74c55cf46618 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:01.784466 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-83ef6146-dada-4e61-90cf-74c55cf46618 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:01.785306 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-83ef6146-dada-4e61-90cf-74c55cf46618 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:01.785762 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-83ef6146-dada-4e61-90cf-74c55cf46618 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:01.811151 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-83ef6146-dada-4e61-90cf-74c55cf46618 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/ips" status: 200 len: 146 microversion: 2.1 time: 0.039451 Dec 23 12:08:01.811726 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 483/1003] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Dec 23 12:08:01 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:08:03.149807 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d62e67e6-e1b6-4aea-8789-91a14ddae38d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bbc2477-e0ec-4717-a210-fa505e62ca03"}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:08:03.150983 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d62e67e6-e1b6-4aea-8789-91a14ddae38d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:03.158457 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d62e67e6-e1b6-4aea-8789-91a14ddae38d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:03.158962 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d62e67e6-e1b6-4aea-8789-91a14ddae38d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:03.159749 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d62e67e6-e1b6-4aea-8789-91a14ddae38d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:03.160186 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d62e67e6-e1b6-4aea-8789-91a14ddae38d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:03.433529 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d62e67e6-e1b6-4aea-8789-91a14ddae38d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287721 Dec 23 12:08:03.434132 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 521/1004] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Dec 23 12:08:03 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:08:10.936799 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-27ba8a25-c2d3-4285-aa6f-15c5f3a4e0d4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:10.937718 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-27ba8a25-c2d3-4285-aa6f-15c5f3a4e0d4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:10.944396 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-27ba8a25-c2d3-4285-aa6f-15c5f3a4e0d4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:10.944911 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-27ba8a25-c2d3-4285-aa6f-15c5f3a4e0d4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:10.945842 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-27ba8a25-c2d3-4285-aa6f-15c5f3a4e0d4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:10.946276 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-27ba8a25-c2d3-4285-aa6f-15c5f3a4e0d4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:10.976919 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-27ba8a25-c2d3-4285-aa6f-15c5f3a4e0d4 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043806 Dec 23 12:08:10.977487 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 484/1005] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:08:10 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:08:10.988965 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e6fa6c81-b156-42b2-83fb-6e564d43474b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:10.989514 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e6fa6c81-b156-42b2-83fb-6e564d43474b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:10.996800 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e6fa6c81-b156-42b2-83fb-6e564d43474b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:10.997274 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e6fa6c81-b156-42b2-83fb-6e564d43474b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:10.998064 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e6fa6c81-b156-42b2-83fb-6e564d43474b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:10.998540 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e6fa6c81-b156-42b2-83fb-6e564d43474b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:11.027369 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e6fa6c81-b156-42b2-83fb-6e564d43474b tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments/5bbc2477-e0ec-4717-a210-fa505e62ca03" status: 200 len: 194 microversion: 2.1 time: 0.043116 Dec 23 12:08:11.027950 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 522/1006] 10.222.0.65 () {58 vars in 1412 bytes} [Thu Dec 23 12:08:10 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments/5bbc2477-e0ec-4717-a210-fa505e62ca03 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:08:12.341725 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b9d31c47-8968-46cd-b532-11c9745f128a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a24b0b28-f7aa-476b-ba2c-c1c546bf868e"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:08:12.342848 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b9d31c47-8968-46cd-b532-11c9745f128a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:12.349471 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b9d31c47-8968-46cd-b532-11c9745f128a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:12.349919 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b9d31c47-8968-46cd-b532-11c9745f128a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:12.350735 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b9d31c47-8968-46cd-b532-11c9745f128a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:12.351138 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b9d31c47-8968-46cd-b532-11c9745f128a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:12.642698 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b9d31c47-8968-46cd-b532-11c9745f128a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304815 Dec 23 12:08:12.643306 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 485/1007] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Dec 23 12:08:12 2021] POST /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:08:17.509762 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-35b40dd1-0aba-4019-9cb2-38fd25fc6f3f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-272697061", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2138957045", "security_groups": [{"name": "tempest-secgroup-smoke-1922405993"}], "block_device_mapping_v2": [{"uuid": "d7b22d35-4596-4950-8398-cc5c8e8f4221", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cb185919-e3e9-4255-a3cb-29bc627cf289"}]}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:08:17.632656 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.network.neutron [None req-35b40dd1-0aba-4019-9cb2-38fd25fc6f3f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] validate_networks() for [('cb185919-e3e9-4255-a3cb-29bc627cf289', None, None, None, None, None)] {{(pid=116354) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 12:08:18.035866 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-35b40dd1-0aba-4019-9cb2-38fd25fc6f3f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Flavor limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 12:08:18.036286 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-35b40dd1-0aba-4019-9cb2-38fd25fc6f3f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Image limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 12:08:18.036763 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-35b40dd1-0aba-4019-9cb2-38fd25fc6f3f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Flavor pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 12:08:18.037176 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-35b40dd1-0aba-4019-9cb2-38fd25fc6f3f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Image pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 12:08:18.037621 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-35b40dd1-0aba-4019-9cb2-38fd25fc6f3f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 12:08:18.047111 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-35b40dd1-0aba-4019-9cb2-38fd25fc6f3f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:18.047585 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-35b40dd1-0aba-4019-9cb2-38fd25fc6f3f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:18.048378 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-35b40dd1-0aba-4019-9cb2-38fd25fc6f3f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:18.048821 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-35b40dd1-0aba-4019-9cb2-38fd25fc6f3f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:18.067141 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-35b40dd1-0aba-4019-9cb2-38fd25fc6f3f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Getting quotas for project 65754771daec4e08922a4c10f20ca653. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:08:18.071742 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-35b40dd1-0aba-4019-9cb2-38fd25fc6f3f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Getting quotas for user 28fb997ba3e94ce4a7cff5d5efe7d4b2 and project 65754771daec4e08922a4c10f20ca653. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:08:18.133721 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-35b40dd1-0aba-4019-9cb2-38fd25fc6f3f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Going to run 1 instances... {{(pid=116354) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 12:08:18.136038 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-35b40dd1-0aba-4019-9cb2-38fd25fc6f3f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d7b22d35-4596-4950-8398-cc5c8e8f4221',volume_size=None,volume_type=None)] {{(pid=116354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 12:08:18.269124 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-35b40dd1-0aba-4019-9cb2-38fd25fc6f3f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762976 Dec 23 12:08:18.269745 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 523/1008] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 12:08:17 2021] POST /compute/v2.1/servers => generated 406 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 12:08:18.280573 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-dea8d1de-5493-466f-be5e-1a0c49a278b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:18.281272 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-dea8d1de-5493-466f-be5e-1a0c49a278b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:18.334496 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-dea8d1de-5493-466f-be5e-1a0c49a278b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:18.341450 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-dea8d1de-5493-466f-be5e-1a0c49a278b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1094 microversion: 2.1 time: 0.065437 Dec 23 12:08:18.342012 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 486/1009] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:18 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:19.358283 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-41db681e-4439-44a1-8450-7b619de377f5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:19.358919 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-41db681e-4439-44a1-8450-7b619de377f5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:19.366308 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-41db681e-4439-44a1-8450-7b619de377f5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:19.366794 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-41db681e-4439-44a1-8450-7b619de377f5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:19.367574 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-41db681e-4439-44a1-8450-7b619de377f5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:19.368009 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-41db681e-4439-44a1-8450-7b619de377f5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:19.431927 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-41db681e-4439-44a1-8450-7b619de377f5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:19.440814 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-41db681e-4439-44a1-8450-7b619de377f5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1192 microversion: 2.1 time: 0.087252 Dec 23 12:08:19.441403 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 524/1010] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:19 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:20.164626 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2c438a10-22ae-4973-94f0-9ef85c0029c8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:20.165610 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2c438a10-22ae-4973-94f0-9ef85c0029c8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:20.172937 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2c438a10-22ae-4973-94f0-9ef85c0029c8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:20.173383 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2c438a10-22ae-4973-94f0-9ef85c0029c8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:20.174162 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2c438a10-22ae-4973-94f0-9ef85c0029c8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:20.174623 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2c438a10-22ae-4973-94f0-9ef85c0029c8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:20.205696 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2c438a10-22ae-4973-94f0-9ef85c0029c8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044878 Dec 23 12:08:20.206467 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 487/1011] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:08:20 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:08:20.457268 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0b03dc32-157c-4f0a-9dae-5ceda073a935 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:20.458043 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0b03dc32-157c-4f0a-9dae-5ceda073a935 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:20.464946 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0b03dc32-157c-4f0a-9dae-5ceda073a935 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:20.465420 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0b03dc32-157c-4f0a-9dae-5ceda073a935 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:20.466273 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0b03dc32-157c-4f0a-9dae-5ceda073a935 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:20.466748 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0b03dc32-157c-4f0a-9dae-5ceda073a935 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:20.497314 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b535829a-5c10-4035-adf8-14eea75b007c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:20.498321 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b535829a-5c10-4035-adf8-14eea75b007c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:20.506557 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b535829a-5c10-4035-adf8-14eea75b007c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:20.507269 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b535829a-5c10-4035-adf8-14eea75b007c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:20.508312 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b535829a-5c10-4035-adf8-14eea75b007c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:20.508936 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b535829a-5c10-4035-adf8-14eea75b007c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:20.702975 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b535829a-5c10-4035-adf8-14eea75b007c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments/5bbc2477-e0ec-4717-a210-fa505e62ca03" status: 200 len: 194 microversion: 2.1 time: 0.212785 Dec 23 12:08:20.703974 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 488/1012] 10.222.0.65 () {58 vars in 1412 bytes} [Thu Dec 23 12:08:20 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments/5bbc2477-e0ec-4717-a210-fa505e62ca03 => generated 194 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:08:20.713792 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5f68d063-5fd2-455d-94f9-69cac5cb72b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:20.714416 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5f68d063-5fd2-455d-94f9-69cac5cb72b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:20.724580 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5f68d063-5fd2-455d-94f9-69cac5cb72b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:20.725268 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5f68d063-5fd2-455d-94f9-69cac5cb72b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:20.726245 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5f68d063-5fd2-455d-94f9-69cac5cb72b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:20.726794 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5f68d063-5fd2-455d-94f9-69cac5cb72b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:20.815487 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.objects.instance [None req-5f68d063-5fd2-455d-94f9-69cac5cb72b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lazy-loading 'services' on Instance uuid c03f128e-f114-443a-adb3-35817870c812 {{(pid=116355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:08:20.894267 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5f68d063-5fd2-455d-94f9-69cac5cb72b2 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments/5bbc2477-e0ec-4717-a210-fa505e62ca03" status: 202 len: 0 microversion: 2.1 time: 0.184396 Dec 23 12:08:20.895032 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 489/1013] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Dec 23 12:08:20 2021] DELETE /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments/5bbc2477-e0ec-4717-a210-fa505e62ca03 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 23 12:08:20.999485 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0b03dc32-157c-4f0a-9dae-5ceda073a935 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:21.015487 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0b03dc32-157c-4f0a-9dae-5ceda073a935 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1278 microversion: 2.1 time: 0.561886 Dec 23 12:08:21.016668 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 525/1014] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:20 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1278 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:08:21.287516 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-08b42d2d-8b9a-41d3-bd05-4f2b795a0002 req-551c71b8-4607-4f24-9ce2-a8200f251da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4296b94b-dffe-4ec6-a620-36342be7c07a", "tag": "3730459e-f7f2-425c-9323-620c407cd290"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:08:21.289445 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:08:21.289445 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:08:21.301406 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-08b42d2d-8b9a-41d3-bd05-4f2b795a0002 req-551c71b8-4607-4f24-9ce2-a8200f251da2 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:21.302806 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-08b42d2d-8b9a-41d3-bd05-4f2b795a0002 req-551c71b8-4607-4f24-9ce2-a8200f251da2 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:21.318837 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-08b42d2d-8b9a-41d3-bd05-4f2b795a0002 req-551c71b8-4607-4f24-9ce2-a8200f251da2 service nova] Creating event network-changed:3730459e-f7f2-425c-9323-620c407cd290 for instance 4296b94b-dffe-4ec6-a620-36342be7c07a on hv-cinder-82282 Dec 23 12:08:21.324478 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-08b42d2d-8b9a-41d3-bd05-4f2b795a0002 req-551c71b8-4607-4f24-9ce2-a8200f251da2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041530 Dec 23 12:08:21.325332 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 490/1015] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:08:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:08:22.033110 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-131d7458-4fc8-4ef4-b20b-8b862f792c86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:22.033672 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-131d7458-4fc8-4ef4-b20b-8b862f792c86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:22.040168 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-131d7458-4fc8-4ef4-b20b-8b862f792c86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:22.040608 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-131d7458-4fc8-4ef4-b20b-8b862f792c86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:22.041466 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-131d7458-4fc8-4ef4-b20b-8b862f792c86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:22.041917 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-131d7458-4fc8-4ef4-b20b-8b862f792c86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:22.242229 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-131d7458-4fc8-4ef4-b20b-8b862f792c86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:22.253425 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-131d7458-4fc8-4ef4-b20b-8b862f792c86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1266 microversion: 2.1 time: 0.223946 Dec 23 12:08:22.254087 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 526/1016] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:22 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:23.061667 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b22f2f9f-392f-48cd-9752-22249ac65118 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:23.062291 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b22f2f9f-392f-48cd-9752-22249ac65118 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:23.069129 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b22f2f9f-392f-48cd-9752-22249ac65118 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:23.069590 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b22f2f9f-392f-48cd-9752-22249ac65118 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:23.070368 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b22f2f9f-392f-48cd-9752-22249ac65118 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:23.070839 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b22f2f9f-392f-48cd-9752-22249ac65118 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:23.098815 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b22f2f9f-392f-48cd-9752-22249ac65118 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments/a24b0b28-f7aa-476b-ba2c-c1c546bf868e" status: 200 len: 194 microversion: 2.1 time: 0.041398 Dec 23 12:08:23.099377 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 491/1017] 10.222.0.65 () {58 vars in 1412 bytes} [Thu Dec 23 12:08:23 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments/a24b0b28-f7aa-476b-ba2c-c1c546bf868e => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:08:23.109484 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-53e6192e-94c2-413e-82ce-a1793894bf65 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:23.110006 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-53e6192e-94c2-413e-82ce-a1793894bf65 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:23.116270 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-53e6192e-94c2-413e-82ce-a1793894bf65 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:23.116708 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-53e6192e-94c2-413e-82ce-a1793894bf65 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:23.117498 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-53e6192e-94c2-413e-82ce-a1793894bf65 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:23.117934 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-53e6192e-94c2-413e-82ce-a1793894bf65 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:23.202491 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-53e6192e-94c2-413e-82ce-a1793894bf65 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lazy-loading 'services' on Instance uuid c03f128e-f114-443a-adb3-35817870c812 {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:08:23.272684 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0801bc79-18b8-4f61-886b-be962cad9854 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:23.273327 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0801bc79-18b8-4f61-886b-be962cad9854 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:23.275328 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-53e6192e-94c2-413e-82ce-a1793894bf65 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments/a24b0b28-f7aa-476b-ba2c-c1c546bf868e" status: 202 len: 0 microversion: 2.1 time: 0.169901 Dec 23 12:08:23.276108 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 527/1018] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Dec 23 12:08:23 2021] DELETE /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments/a24b0b28-f7aa-476b-ba2c-c1c546bf868e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:08:23.280516 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0801bc79-18b8-4f61-886b-be962cad9854 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:23.280968 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0801bc79-18b8-4f61-886b-be962cad9854 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:23.281762 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0801bc79-18b8-4f61-886b-be962cad9854 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:23.282271 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0801bc79-18b8-4f61-886b-be962cad9854 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:23.425019 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0801bc79-18b8-4f61-886b-be962cad9854 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:23.436530 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0801bc79-18b8-4f61-886b-be962cad9854 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1266 microversion: 2.1 time: 0.167279 Dec 23 12:08:23.437302 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 492/1019] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:23 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:08:24.439980 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0c544ba8-c365-4e08-b87e-3f28ef2d5269 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:24.441055 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0c544ba8-c365-4e08-b87e-3f28ef2d5269 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:24.447785 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0c544ba8-c365-4e08-b87e-3f28ef2d5269 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:24.448263 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0c544ba8-c365-4e08-b87e-3f28ef2d5269 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:24.449024 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0c544ba8-c365-4e08-b87e-3f28ef2d5269 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:24.449494 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-0c544ba8-c365-4e08-b87e-3f28ef2d5269 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:24.453527 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e19d85bb-621a-437c-af21-d5406dd0391e tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:24.454379 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e19d85bb-621a-437c-af21-d5406dd0391e tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:24.461087 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e19d85bb-621a-437c-af21-d5406dd0391e tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:24.461543 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e19d85bb-621a-437c-af21-d5406dd0391e tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:24.462386 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e19d85bb-621a-437c-af21-d5406dd0391e tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:24.462866 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e19d85bb-621a-437c-af21-d5406dd0391e tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:24.478497 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0c544ba8-c365-4e08-b87e-3f28ef2d5269 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043119 Dec 23 12:08:24.479087 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 528/1020] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:08:24 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:08:24.583448 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d86350f2-62e1-4e16-82b5-20ef3aaab053 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:24.584373 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d86350f2-62e1-4e16-82b5-20ef3aaab053 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:24.590093 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d86350f2-62e1-4e16-82b5-20ef3aaab053 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:24.590665 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d86350f2-62e1-4e16-82b5-20ef3aaab053 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:24.591653 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d86350f2-62e1-4e16-82b5-20ef3aaab053 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:24.592157 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d86350f2-62e1-4e16-82b5-20ef3aaab053 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:24.599084 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e19d85bb-621a-437c-af21-d5406dd0391e tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:24.607230 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e19d85bb-621a-437c-af21-d5406dd0391e tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1266 microversion: 2.1 time: 0.157124 Dec 23 12:08:24.607770 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 493/1021] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:24 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:24.621382 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d86350f2-62e1-4e16-82b5-20ef3aaab053 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041662 Dec 23 12:08:24.622183 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 529/1022] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:08:24 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 23 12:08:24.675449 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4ed4492d-c71d-48d8-94fe-ea6183fb37c8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:24.675946 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4ed4492d-c71d-48d8-94fe-ea6183fb37c8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:24.682218 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4ed4492d-c71d-48d8-94fe-ea6183fb37c8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:24.682701 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4ed4492d-c71d-48d8-94fe-ea6183fb37c8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:24.683469 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4ed4492d-c71d-48d8-94fe-ea6183fb37c8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:24.683905 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4ed4492d-c71d-48d8-94fe-ea6183fb37c8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:24.710278 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4ed4492d-c71d-48d8-94fe-ea6183fb37c8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Going to try to terminate instance {{(pid=116355) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:08:24.796232 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4ed4492d-c71d-48d8-94fe-ea6183fb37c8 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 204 len: 0 microversion: 2.1 time: 0.124136 Dec 23 12:08:24.797330 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 494/1023] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:08:24 2021] DELETE /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:08:24.805543 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-07d0494d-286b-4abe-a12a-081cbb5a86a3 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:24.806309 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-07d0494d-286b-4abe-a12a-081cbb5a86a3 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:24.812834 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-07d0494d-286b-4abe-a12a-081cbb5a86a3 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:24.813300 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-07d0494d-286b-4abe-a12a-081cbb5a86a3 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:24.814093 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-07d0494d-286b-4abe-a12a-081cbb5a86a3 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:24.814554 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-07d0494d-286b-4abe-a12a-081cbb5a86a3 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:24.957599 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-07d0494d-286b-4abe-a12a-081cbb5a86a3 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:24.968328 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-07d0494d-286b-4abe-a12a-081cbb5a86a3 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 200 len: 1673 microversion: 2.1 time: 0.166615 Dec 23 12:08:24.969049 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 530/1024] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:24 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:25.628611 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-06e18029-9b26-4ea4-9872-224fcc157200 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:25.629575 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-06e18029-9b26-4ea4-9872-224fcc157200 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:25.639392 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-06e18029-9b26-4ea4-9872-224fcc157200 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:25.639846 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-06e18029-9b26-4ea4-9872-224fcc157200 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:25.640624 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-06e18029-9b26-4ea4-9872-224fcc157200 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:25.641060 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-06e18029-9b26-4ea4-9872-224fcc157200 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:25.792297 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-06e18029-9b26-4ea4-9872-224fcc157200 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:25.800795 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-06e18029-9b26-4ea4-9872-224fcc157200 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1266 microversion: 2.1 time: 0.179368 Dec 23 12:08:25.801358 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 495/1025] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:25 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:25.995374 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1d7a081c-f85c-49da-a71c-7fe986b6615a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:25.996247 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1d7a081c-f85c-49da-a71c-7fe986b6615a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:26.004457 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1d7a081c-f85c-49da-a71c-7fe986b6615a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:26.004927 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1d7a081c-f85c-49da-a71c-7fe986b6615a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:26.005716 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1d7a081c-f85c-49da-a71c-7fe986b6615a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:26.006158 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1d7a081c-f85c-49da-a71c-7fe986b6615a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:26.162345 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1d7a081c-f85c-49da-a71c-7fe986b6615a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:26.169898 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1d7a081c-f85c-49da-a71c-7fe986b6615a tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 200 len: 1673 microversion: 2.1 time: 0.181472 Dec 23 12:08:26.170528 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 531/1026] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:25 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:26.818217 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d5d82f47-d0c5-4fa5-8a79-3159c32c1df4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:26.818853 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d5d82f47-d0c5-4fa5-8a79-3159c32c1df4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:26.825567 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d5d82f47-d0c5-4fa5-8a79-3159c32c1df4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:26.826020 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d5d82f47-d0c5-4fa5-8a79-3159c32c1df4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:26.826841 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d5d82f47-d0c5-4fa5-8a79-3159c32c1df4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:26.827283 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d5d82f47-d0c5-4fa5-8a79-3159c32c1df4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:26.965526 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d5d82f47-d0c5-4fa5-8a79-3159c32c1df4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:26.974145 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d5d82f47-d0c5-4fa5-8a79-3159c32c1df4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1266 microversion: 2.1 time: 0.159760 Dec 23 12:08:26.974902 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 496/1027] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:26 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:27.190449 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-49de8df5-15aa-4e41-968f-2e2645fc0df1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:27.191077 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-49de8df5-15aa-4e41-968f-2e2645fc0df1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:27.197801 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-49de8df5-15aa-4e41-968f-2e2645fc0df1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:27.198247 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-49de8df5-15aa-4e41-968f-2e2645fc0df1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:27.199074 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-49de8df5-15aa-4e41-968f-2e2645fc0df1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:27.199504 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-49de8df5-15aa-4e41-968f-2e2645fc0df1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:27.446444 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-49de8df5-15aa-4e41-968f-2e2645fc0df1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:27.454770 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-49de8df5-15aa-4e41-968f-2e2645fc0df1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 200 len: 1673 microversion: 2.1 time: 0.270090 Dec 23 12:08:27.455335 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 532/1028] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:27 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 1673 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:27.991761 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-bdfb85ee-6494-4bbf-afd3-4e92c6a8575b tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:27.992626 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-bdfb85ee-6494-4bbf-afd3-4e92c6a8575b tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:28.000700 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bdfb85ee-6494-4bbf-afd3-4e92c6a8575b tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:28.001082 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bdfb85ee-6494-4bbf-afd3-4e92c6a8575b tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:28.001866 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bdfb85ee-6494-4bbf-afd3-4e92c6a8575b tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:28.002300 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bdfb85ee-6494-4bbf-afd3-4e92c6a8575b tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:28.029834 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-1193391d-e2ca-4392-ba8a-90a934526a91 req-5f64abf3-738e-4bf9-be01-33cfbc2c9e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03f128e-f114-443a-adb3-35817870c812", "name": "network-vif-deleted", "tag": "114be167-612f-43f6-9558-67fd2fe303ec"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:08:28.031737 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:08:28.031737 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:08:28.039250 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-1193391d-e2ca-4392-ba8a-90a934526a91 req-5f64abf3-738e-4bf9-be01-33cfbc2c9e3d service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:28.039707 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-1193391d-e2ca-4392-ba8a-90a934526a91 req-5f64abf3-738e-4bf9-be01-33cfbc2c9e3d service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:28.050856 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-1193391d-e2ca-4392-ba8a-90a934526a91 req-5f64abf3-738e-4bf9-be01-33cfbc2c9e3d service nova] Creating event network-vif-deleted:114be167-612f-43f6-9558-67fd2fe303ec for instance c03f128e-f114-443a-adb3-35817870c812 on hv-cinder-82282 Dec 23 12:08:28.056244 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-1193391d-e2ca-4392-ba8a-90a934526a91 req-5f64abf3-738e-4bf9-be01-33cfbc2c9e3d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034388 Dec 23 12:08:28.057164 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 533/1029] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:08:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 12:08:28.179257 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-bdfb85ee-6494-4bbf-afd3-4e92c6a8575b tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:28.187679 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-bdfb85ee-6494-4bbf-afd3-4e92c6a8575b tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1266 microversion: 2.1 time: 0.199947 Dec 23 12:08:28.188529 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 497/1030] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:27 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:28.473434 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ff33226d-b1af-46d7-954c-620a15afdaa1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:28.474131 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ff33226d-b1af-46d7-954c-620a15afdaa1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:28.480774 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ff33226d-b1af-46d7-954c-620a15afdaa1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:28.481256 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ff33226d-b1af-46d7-954c-620a15afdaa1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:28.482415 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ff33226d-b1af-46d7-954c-620a15afdaa1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:28.483076 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ff33226d-b1af-46d7-954c-620a15afdaa1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:28.514646 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ff33226d-b1af-46d7-954c-620a15afdaa1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:28.515047 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ff33226d-b1af-46d7-954c-620a15afdaa1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:28.515663 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-ff33226d-b1af-46d7-954c-620a15afdaa1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lazy-loading 'fault' on Instance uuid c03f128e-f114-443a-adb3-35817870c812 {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:08:28.555135 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ff33226d-b1af-46d7-954c-620a15afdaa1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a351cbc96e894a03906076d2652272a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a1e536ed4249adb353b71e8bf03cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:28.562740 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ff33226d-b1af-46d7-954c-620a15afdaa1 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 200 len: 1327 microversion: 2.1 time: 0.093912 Dec 23 12:08:28.572343 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 534/1031] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:28 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:29.209190 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3c26133d-4834-444f-9fbf-9faa913fd9a0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:29.210163 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3c26133d-4834-444f-9fbf-9faa913fd9a0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:29.219734 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3c26133d-4834-444f-9fbf-9faa913fd9a0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:29.220193 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3c26133d-4834-444f-9fbf-9faa913fd9a0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:29.220978 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3c26133d-4834-444f-9fbf-9faa913fd9a0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:29.221420 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3c26133d-4834-444f-9fbf-9faa913fd9a0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:29.354414 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3c26133d-4834-444f-9fbf-9faa913fd9a0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:29.363165 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3c26133d-4834-444f-9fbf-9faa913fd9a0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1266 microversion: 2.1 time: 0.160444 Dec 23 12:08:29.363706 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 498/1032] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:29 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:29.688143 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-749eb609-61d1-465d-a9a6-a713cde0e4c5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:29.688771 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-749eb609-61d1-465d-a9a6-a713cde0e4c5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:29.694807 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-749eb609-61d1-465d-a9a6-a713cde0e4c5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:29.695256 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-749eb609-61d1-465d-a9a6-a713cde0e4c5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:29.696063 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-749eb609-61d1-465d-a9a6-a713cde0e4c5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:29.696522 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-749eb609-61d1-465d-a9a6-a713cde0e4c5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:29.709438 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-749eb609-61d1-465d-a9a6-a713cde0e4c5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] HTTP exception thrown: Instance c03f128e-f114-443a-adb3-35817870c812 could not be found. Dec 23 12:08:29.710009 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-749eb609-61d1-465d-a9a6-a713cde0e4c5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Returning 404 to user: Instance c03f128e-f114-443a-adb3-35817870c812 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:08:29.710862 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-749eb609-61d1-465d-a9a6-a713cde0e4c5 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 404 len: 111 microversion: 2.1 time: 0.134476 Dec 23 12:08:29.711381 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 535/1033] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:29 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:08:29.719815 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0f940793-3a1c-415f-be32-0ea25f9ea978 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '.version_select at 0x7fcf2862f670>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:29.739969 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0f940793-3a1c-415f-be32-0ea25f9ea978 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807352179" status: 202 len: 0 microversion: 2.1 time: 0.023850 Dec 23 12:08:29.740512 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 499/1034] 10.222.0.65 () {58 vars in 1220 bytes} [Thu Dec 23 12:08:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807352179 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:08:30.380017 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c0763ecf-824d-4201-b1fb-95e319957627 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:30.380643 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c0763ecf-824d-4201-b1fb-95e319957627 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:30.387480 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c0763ecf-824d-4201-b1fb-95e319957627 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:30.387947 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c0763ecf-824d-4201-b1fb-95e319957627 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:30.388784 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c0763ecf-824d-4201-b1fb-95e319957627 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:30.389376 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c0763ecf-824d-4201-b1fb-95e319957627 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:30.530009 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c0763ecf-824d-4201-b1fb-95e319957627 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:30.537623 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c0763ecf-824d-4201-b1fb-95e319957627 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1266 microversion: 2.1 time: 0.161328 Dec 23 12:08:30.538189 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 536/1035] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:30 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:31.555087 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e3d30e99-4939-4a3a-b91e-aee92c2e0727 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:31.555806 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e3d30e99-4939-4a3a-b91e-aee92c2e0727 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:31.562844 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e3d30e99-4939-4a3a-b91e-aee92c2e0727 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:31.563412 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e3d30e99-4939-4a3a-b91e-aee92c2e0727 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:31.564199 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e3d30e99-4939-4a3a-b91e-aee92c2e0727 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:31.564823 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e3d30e99-4939-4a3a-b91e-aee92c2e0727 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:31.824353 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e3d30e99-4939-4a3a-b91e-aee92c2e0727 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:31.832763 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e3d30e99-4939-4a3a-b91e-aee92c2e0727 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1266 microversion: 2.1 time: 0.281999 Dec 23 12:08:31.833521 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 500/1036] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:31 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:32.658964 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ba88fd7a-eb33-44bb-89a1-46645e61b63d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:32.659523 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ba88fd7a-eb33-44bb-89a1-46645e61b63d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:32.666098 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ba88fd7a-eb33-44bb-89a1-46645e61b63d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:32.666625 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ba88fd7a-eb33-44bb-89a1-46645e61b63d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:32.667517 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ba88fd7a-eb33-44bb-89a1-46645e61b63d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:32.667987 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ba88fd7a-eb33-44bb-89a1-46645e61b63d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:32.681776 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-ba88fd7a-eb33-44bb-89a1-46645e61b63d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] HTTP exception thrown: Instance c03f128e-f114-443a-adb3-35817870c812 could not be found. Dec 23 12:08:32.682374 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ba88fd7a-eb33-44bb-89a1-46645e61b63d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Returning 404 to user: Instance c03f128e-f114-443a-adb3-35817870c812 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:08:32.683252 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ba88fd7a-eb33-44bb-89a1-46645e61b63d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 404 len: 111 microversion: 2.1 time: 0.029050 Dec 23 12:08:32.683789 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 537/1037] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:08:32 2021] DELETE /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:08:32.691880 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-dea31b2c-b7ea-4826-9c45-5328428a4a2d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:32.692520 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-dea31b2c-b7ea-4826-9c45-5328428a4a2d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: c03f128e-f114-443a-adb3-35817870c812] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:32.698912 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dea31b2c-b7ea-4826-9c45-5328428a4a2d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:32.699345 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dea31b2c-b7ea-4826-9c45-5328428a4a2d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:32.700115 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dea31b2c-b7ea-4826-9c45-5328428a4a2d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:32.700576 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dea31b2c-b7ea-4826-9c45-5328428a4a2d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:32.713842 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-dea31b2c-b7ea-4826-9c45-5328428a4a2d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] HTTP exception thrown: Instance c03f128e-f114-443a-adb3-35817870c812 could not be found. Dec 23 12:08:32.714412 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-dea31b2c-b7ea-4826-9c45-5328428a4a2d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Returning 404 to user: Instance c03f128e-f114-443a-adb3-35817870c812 could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:08:32.715276 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-dea31b2c-b7ea-4826-9c45-5328428a4a2d tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812" status: 404 len: 111 microversion: 2.1 time: 0.027229 Dec 23 12:08:32.715814 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 501/1038] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:32 2021] GET /compute/v2.1/servers/c03f128e-f114-443a-adb3-35817870c812 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:08:32.756901 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-b9d0b55b-aa84-4929-9518-6658fdf79ebf req-4bffa1a0-608b-4758-8184-6806a3c6ea00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4296b94b-dffe-4ec6-a620-36342be7c07a", "name": "network-vif-plugged", "status": "completed", "tag": "3730459e-f7f2-425c-9323-620c407cd290"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:08:32.758717 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:08:32.758717 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:08:32.767071 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-b9d0b55b-aa84-4929-9518-6658fdf79ebf req-4bffa1a0-608b-4758-8184-6806a3c6ea00 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:32.767521 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-b9d0b55b-aa84-4929-9518-6658fdf79ebf req-4bffa1a0-608b-4758-8184-6806a3c6ea00 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:32.781099 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-b9d0b55b-aa84-4929-9518-6658fdf79ebf req-4bffa1a0-608b-4758-8184-6806a3c6ea00 service nova] Creating event network-vif-plugged:3730459e-f7f2-425c-9323-620c407cd290 for instance 4296b94b-dffe-4ec6-a620-36342be7c07a on hv-cinder-82282 Dec 23 12:08:32.786111 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-b9d0b55b-aa84-4929-9518-6658fdf79ebf req-4bffa1a0-608b-4758-8184-6806a3c6ea00 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033361 Dec 23 12:08:32.786993 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 538/1039] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:08:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:08:32.853821 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f0607851-670e-4aeb-84e8-e3b0e518176f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:32.854712 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f0607851-670e-4aeb-84e8-e3b0e518176f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:32.861520 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f0607851-670e-4aeb-84e8-e3b0e518176f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:32.861980 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f0607851-670e-4aeb-84e8-e3b0e518176f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:32.862801 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f0607851-670e-4aeb-84e8-e3b0e518176f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:32.863241 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f0607851-670e-4aeb-84e8-e3b0e518176f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:33.008385 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-f0607851-670e-4aeb-84e8-e3b0e518176f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:33.017543 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f0607851-670e-4aeb-84e8-e3b0e518176f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1266 microversion: 2.1 time: 0.167384 Dec 23 12:08:33.018959 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 502/1040] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:32 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:33.865445 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-6bd2c9e9-c815-43a8-b738-f9c35812731c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:33.866037 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-6bd2c9e9-c815-43a8-b738-f9c35812731c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:33.873108 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6bd2c9e9-c815-43a8-b738-f9c35812731c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:33.873825 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6bd2c9e9-c815-43a8-b738-f9c35812731c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:33.874647 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6bd2c9e9-c815-43a8-b738-f9c35812731c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:33.875092 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6bd2c9e9-c815-43a8-b738-f9c35812731c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:33.888510 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-6bd2c9e9-c815-43a8-b738-f9c35812731c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] HTTP exception thrown: Instance f3b18df5-9ce3-44cb-8a62-730a959e46ac could not be found. Dec 23 12:08:33.889181 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-6bd2c9e9-c815-43a8-b738-f9c35812731c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Returning 404 to user: Instance f3b18df5-9ce3-44cb-8a62-730a959e46ac could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:08:33.890051 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-6bd2c9e9-c815-43a8-b738-f9c35812731c tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 404 len: 111 microversion: 2.1 time: 0.028887 Dec 23 12:08:33.890769 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 539/1041] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:08:33 2021] DELETE /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:08:33.898644 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-dd45d6fe-9675-4930-8ffe-7446c188c373 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:33.899255 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-dd45d6fe-9675-4930-8ffe-7446c188c373 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] [instance: f3b18df5-9ce3-44cb-8a62-730a959e46ac] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:33.905837 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dd45d6fe-9675-4930-8ffe-7446c188c373 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:33.906281 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dd45d6fe-9675-4930-8ffe-7446c188c373 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:33.907093 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dd45d6fe-9675-4930-8ffe-7446c188c373 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:33.907554 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dd45d6fe-9675-4930-8ffe-7446c188c373 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:33.922176 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-dd45d6fe-9675-4930-8ffe-7446c188c373 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] HTTP exception thrown: Instance f3b18df5-9ce3-44cb-8a62-730a959e46ac could not be found. Dec 23 12:08:33.922799 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-dd45d6fe-9675-4930-8ffe-7446c188c373 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] Returning 404 to user: Instance f3b18df5-9ce3-44cb-8a62-730a959e46ac could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:08:33.923604 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-dd45d6fe-9675-4930-8ffe-7446c188c373 tempest-AttachVolumeTestJSON-148399196 tempest-AttachVolumeTestJSON-148399196-project] 10.222.0.65 "GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac" status: 404 len: 111 microversion: 2.1 time: 0.028808 Dec 23 12:08:33.924108 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 503/1042] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:33 2021] GET /compute/v2.1/servers/f3b18df5-9ce3-44cb-8a62-730a959e46ac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:08:34.034661 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-53677602-f86f-446c-b897-80f6a513ffd7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:34.035405 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-53677602-f86f-446c-b897-80f6a513ffd7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:34.041935 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-53677602-f86f-446c-b897-80f6a513ffd7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:34.042472 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-53677602-f86f-446c-b897-80f6a513ffd7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:34.043476 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-53677602-f86f-446c-b897-80f6a513ffd7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:34.043952 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-53677602-f86f-446c-b897-80f6a513ffd7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:34.315536 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-53677602-f86f-446c-b897-80f6a513ffd7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:34.323243 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-53677602-f86f-446c-b897-80f6a513ffd7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1266 microversion: 2.1 time: 0.292401 Dec 23 12:08:34.323882 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 540/1043] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:34 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:35.340894 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0b995e20-6e98-4a35-93c5-1e09602359ca tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:35.341548 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0b995e20-6e98-4a35-93c5-1e09602359ca tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:35.348383 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0b995e20-6e98-4a35-93c5-1e09602359ca tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:35.348845 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0b995e20-6e98-4a35-93c5-1e09602359ca tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:35.349677 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0b995e20-6e98-4a35-93c5-1e09602359ca tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:35.350090 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0b995e20-6e98-4a35-93c5-1e09602359ca tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:35.569895 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0b995e20-6e98-4a35-93c5-1e09602359ca tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:35.578645 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0b995e20-6e98-4a35-93c5-1e09602359ca tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1452 microversion: 2.1 time: 0.241383 Dec 23 12:08:35.579219 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 504/1044] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:35 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1452 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:35.594678 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d3af05e6-9043-4f6f-8743-f3e5f493af31 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:35.595226 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d3af05e6-9043-4f6f-8743-f3e5f493af31 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:35.601407 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d3af05e6-9043-4f6f-8743-f3e5f493af31 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:35.602087 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d3af05e6-9043-4f6f-8743-f3e5f493af31 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:35.602896 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d3af05e6-9043-4f6f-8743-f3e5f493af31 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:35.603330 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d3af05e6-9043-4f6f-8743-f3e5f493af31 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:35.738255 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-d3af05e6-9043-4f6f-8743-f3e5f493af31 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:35.746392 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d3af05e6-9043-4f6f-8743-f3e5f493af31 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1452 microversion: 2.1 time: 0.155662 Dec 23 12:08:35.746994 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 541/1045] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:35 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:37.926956 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-0f61daf0-612b-40bb-9442-7d5fbac2d683 req-00ab3ef0-eab1-4243-a066-6b9b39384411 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4296b94b-dffe-4ec6-a620-36342be7c07a", "tag": "3730459e-f7f2-425c-9323-620c407cd290"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:08:37.926956 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:08:37.926956 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:08:37.929307 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-0f61daf0-612b-40bb-9442-7d5fbac2d683 req-00ab3ef0-eab1-4243-a066-6b9b39384411 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:37.929967 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-0f61daf0-612b-40bb-9442-7d5fbac2d683 req-00ab3ef0-eab1-4243-a066-6b9b39384411 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:37.942152 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-0f61daf0-612b-40bb-9442-7d5fbac2d683 req-00ab3ef0-eab1-4243-a066-6b9b39384411 service nova] Creating event network-changed:3730459e-f7f2-425c-9323-620c407cd290 for instance 4296b94b-dffe-4ec6-a620-36342be7c07a on hv-cinder-82282 Dec 23 12:08:37.947233 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-0f61daf0-612b-40bb-9442-7d5fbac2d683 req-00ab3ef0-eab1-4243-a066-6b9b39384411 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030828 Dec 23 12:08:37.948223 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 505/1046] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:08:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:08:39.455933 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b6441870-98d0-46ca-bbd6-77a7487ca07e tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1914164933", "imageRef": "938a78c0-341e-4043-927a-9bfe8cf52508", "flavorRef": "452", "networks": [{"uuid": "9e6a1d94-c46e-428b-b262-4cd9011990b5"}]}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:08:39.521004 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.network.neutron [None req-b6441870-98d0-46ca-bbd6-77a7487ca07e tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] validate_networks() for [('9e6a1d94-c46e-428b-b262-4cd9011990b5', None, None, None, None, None)] {{(pid=116354) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 12:08:39.904241 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-b6441870-98d0-46ca-bbd6-77a7487ca07e tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Flavor limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 12:08:39.904698 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-b6441870-98d0-46ca-bbd6-77a7487ca07e tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Image limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 12:08:39.905171 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-b6441870-98d0-46ca-bbd6-77a7487ca07e tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Flavor pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 12:08:39.905563 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-b6441870-98d0-46ca-bbd6-77a7487ca07e tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Image pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 12:08:39.905971 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-b6441870-98d0-46ca-bbd6-77a7487ca07e tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 12:08:39.915918 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b6441870-98d0-46ca-bbd6-77a7487ca07e tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:39.916371 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b6441870-98d0-46ca-bbd6-77a7487ca07e tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:39.917195 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b6441870-98d0-46ca-bbd6-77a7487ca07e tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:39.917633 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b6441870-98d0-46ca-bbd6-77a7487ca07e tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:39.933863 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-b6441870-98d0-46ca-bbd6-77a7487ca07e tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Getting quotas for project a2b2d4247c1e4c7aa7b75187a8a189f2. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:08:39.938600 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-b6441870-98d0-46ca-bbd6-77a7487ca07e tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Getting quotas for user 48979a77dffa4ec5a51dfab475185430 and project a2b2d4247c1e4c7aa7b75187a8a189f2. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:08:39.951716 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b6441870-98d0-46ca-bbd6-77a7487ca07e tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Going to run 1 instances... {{(pid=116354) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 12:08:39.954113 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b6441870-98d0-46ca-bbd6-77a7487ca07e tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='938a78c0-341e-4043-927a-9bfe8cf52508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 12:08:40.012536 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b6441870-98d0-46ca-bbd6-77a7487ca07e tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673050 Dec 23 12:08:40.013170 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 542/1047] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 12:08:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 12:08:40.024349 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b225e161-d728-4b3d-96d3-d9486372cc55 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:40.025136 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b225e161-d728-4b3d-96d3-d9486372cc55 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:40.078059 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b225e161-d728-4b3d-96d3-d9486372cc55 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:40.084752 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b225e161-d728-4b3d-96d3-d9486372cc55 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660" status: 200 len: 1218 microversion: 2.1 time: 0.064936 Dec 23 12:08:40.085461 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 506/1048] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:40 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:41.102338 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4c0ae66f-7b2c-4cf5-a869-1ae17976c887 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:41.103625 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4c0ae66f-7b2c-4cf5-a869-1ae17976c887 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:41.110885 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4c0ae66f-7b2c-4cf5-a869-1ae17976c887 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:41.111337 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4c0ae66f-7b2c-4cf5-a869-1ae17976c887 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:41.112114 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4c0ae66f-7b2c-4cf5-a869-1ae17976c887 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:41.112517 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4c0ae66f-7b2c-4cf5-a869-1ae17976c887 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:41.177985 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4c0ae66f-7b2c-4cf5-a869-1ae17976c887 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:41.185820 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4c0ae66f-7b2c-4cf5-a869-1ae17976c887 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660" status: 200 len: 1270 microversion: 2.1 time: 0.087152 Dec 23 12:08:41.186395 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 543/1049] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:41 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:42.204411 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-9d08cac7-7182-413e-b938-5f82939dd913 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:42.205021 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-9d08cac7-7182-413e-b938-5f82939dd913 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:42.212469 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9d08cac7-7182-413e-b938-5f82939dd913 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:42.212927 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9d08cac7-7182-413e-b938-5f82939dd913 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:42.213750 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9d08cac7-7182-413e-b938-5f82939dd913 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:42.214188 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9d08cac7-7182-413e-b938-5f82939dd913 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:42.431401 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-9d08cac7-7182-413e-b938-5f82939dd913 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:42.439166 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-9d08cac7-7182-413e-b938-5f82939dd913 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660" status: 200 len: 1318 microversion: 2.1 time: 0.239145 Dec 23 12:08:42.439795 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 507/1050] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:42 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:42.626748 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-dc7f8dc6-e3e6-4638-a9d6-39fa1bf23dbb req-e2e32545-4840-4525-8e01-0c81071359bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b856ae79-8acf-4de6-bf2d-82b2fe07f660", "tag": "53da5b0d-4c2f-49b5-9f52-322e6cf44b13"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:08:42.628971 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:08:42.628971 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:08:42.636613 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-dc7f8dc6-e3e6-4638-a9d6-39fa1bf23dbb req-e2e32545-4840-4525-8e01-0c81071359bf service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:42.637387 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-dc7f8dc6-e3e6-4638-a9d6-39fa1bf23dbb req-e2e32545-4840-4525-8e01-0c81071359bf service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:42.652450 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-dc7f8dc6-e3e6-4638-a9d6-39fa1bf23dbb req-e2e32545-4840-4525-8e01-0c81071359bf service nova] Creating event network-changed:53da5b0d-4c2f-49b5-9f52-322e6cf44b13 for instance b856ae79-8acf-4de6-bf2d-82b2fe07f660 on hv-cinder-82282 Dec 23 12:08:42.658712 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-dc7f8dc6-e3e6-4638-a9d6-39fa1bf23dbb req-e2e32545-4840-4525-8e01-0c81071359bf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036477 Dec 23 12:08:42.659314 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 544/1051] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:08:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:08:43.456486 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d4b04b78-d10b-43f7-aab1-eab6ee6d2ecd tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:43.457076 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d4b04b78-d10b-43f7-aab1-eab6ee6d2ecd tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:43.463727 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d4b04b78-d10b-43f7-aab1-eab6ee6d2ecd tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:43.464181 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d4b04b78-d10b-43f7-aab1-eab6ee6d2ecd tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:43.464967 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d4b04b78-d10b-43f7-aab1-eab6ee6d2ecd tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:43.465404 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d4b04b78-d10b-43f7-aab1-eab6ee6d2ecd tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:43.652762 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d4b04b78-d10b-43f7-aab1-eab6ee6d2ecd tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:43.660751 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d4b04b78-d10b-43f7-aab1-eab6ee6d2ecd tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660" status: 200 len: 1318 microversion: 2.1 time: 0.208045 Dec 23 12:08:43.661295 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 508/1052] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:43 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:44.684080 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1b93c896-0836-42d6-a4c2-38abe7b1397d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:44.685179 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1b93c896-0836-42d6-a4c2-38abe7b1397d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:44.693233 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1b93c896-0836-42d6-a4c2-38abe7b1397d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:44.693693 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1b93c896-0836-42d6-a4c2-38abe7b1397d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:44.694483 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1b93c896-0836-42d6-a4c2-38abe7b1397d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:44.694960 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1b93c896-0836-42d6-a4c2-38abe7b1397d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:44.835304 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-1b93c896-0836-42d6-a4c2-38abe7b1397d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:44.843385 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1b93c896-0836-42d6-a4c2-38abe7b1397d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660" status: 200 len: 1318 microversion: 2.1 time: 0.167844 Dec 23 12:08:44.844253 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 545/1053] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:44 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:45.863076 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8347fb42-fc18-48b3-adb7-45cb027d3e75 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:45.863679 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-8347fb42-fc18-48b3-adb7-45cb027d3e75 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:45.871139 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8347fb42-fc18-48b3-adb7-45cb027d3e75 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:45.871632 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8347fb42-fc18-48b3-adb7-45cb027d3e75 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:45.872463 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8347fb42-fc18-48b3-adb7-45cb027d3e75 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:45.872927 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8347fb42-fc18-48b3-adb7-45cb027d3e75 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:46.014353 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-8347fb42-fc18-48b3-adb7-45cb027d3e75 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:46.023106 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-8347fb42-fc18-48b3-adb7-45cb027d3e75 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660" status: 200 len: 1318 microversion: 2.1 time: 0.164422 Dec 23 12:08:46.023676 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 509/1054] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:45 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:47.043400 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-47fe04ae-4ab7-46d2-903e-739be35b9e29 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:47.044397 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-47fe04ae-4ab7-46d2-903e-739be35b9e29 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:47.055268 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-47fe04ae-4ab7-46d2-903e-739be35b9e29 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:47.056013 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-47fe04ae-4ab7-46d2-903e-739be35b9e29 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:47.057289 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-47fe04ae-4ab7-46d2-903e-739be35b9e29 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:47.058021 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-47fe04ae-4ab7-46d2-903e-739be35b9e29 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:47.213874 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-47fe04ae-4ab7-46d2-903e-739be35b9e29 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:47.221811 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-47fe04ae-4ab7-46d2-903e-739be35b9e29 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660" status: 200 len: 1318 microversion: 2.1 time: 0.184750 Dec 23 12:08:47.222373 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 546/1055] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:47 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:48.242579 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-28236831-3b5f-438d-aa8c-d3b99ac83d87 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:48.243602 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-28236831-3b5f-438d-aa8c-d3b99ac83d87 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:48.254297 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-28236831-3b5f-438d-aa8c-d3b99ac83d87 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:48.255094 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-28236831-3b5f-438d-aa8c-d3b99ac83d87 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:48.256367 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-28236831-3b5f-438d-aa8c-d3b99ac83d87 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:48.257087 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-28236831-3b5f-438d-aa8c-d3b99ac83d87 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:48.395910 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-28236831-3b5f-438d-aa8c-d3b99ac83d87 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:48.406652 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-28236831-3b5f-438d-aa8c-d3b99ac83d87 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660" status: 200 len: 1318 microversion: 2.1 time: 0.170232 Dec 23 12:08:48.407248 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 510/1056] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:48 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:48.829458 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-3d31add1-4d65-4986-89ca-aa0962ad915a req-6716af11-1160-4efb-95c4-3b288b3a2843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b856ae79-8acf-4de6-bf2d-82b2fe07f660", "name": "network-vif-plugged", "status": "completed", "tag": "53da5b0d-4c2f-49b5-9f52-322e6cf44b13"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:08:48.831257 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:08:48.831257 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:08:48.840276 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-3d31add1-4d65-4986-89ca-aa0962ad915a req-6716af11-1160-4efb-95c4-3b288b3a2843 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:48.840732 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-3d31add1-4d65-4986-89ca-aa0962ad915a req-6716af11-1160-4efb-95c4-3b288b3a2843 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:48.853275 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-3d31add1-4d65-4986-89ca-aa0962ad915a req-6716af11-1160-4efb-95c4-3b288b3a2843 service nova] Creating event network-vif-plugged:53da5b0d-4c2f-49b5-9f52-322e6cf44b13 for instance b856ae79-8acf-4de6-bf2d-82b2fe07f660 on hv-cinder-82282 Dec 23 12:08:48.858937 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-3d31add1-4d65-4986-89ca-aa0962ad915a req-6716af11-1160-4efb-95c4-3b288b3a2843 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033274 Dec 23 12:08:48.859631 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 547/1057] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:08:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:08:49.430233 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4efa2f81-8d5b-4a1f-b8f0-1200dfe2a29d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:49.431963 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4efa2f81-8d5b-4a1f-b8f0-1200dfe2a29d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:49.441447 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4efa2f81-8d5b-4a1f-b8f0-1200dfe2a29d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:49.442372 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4efa2f81-8d5b-4a1f-b8f0-1200dfe2a29d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:49.443910 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4efa2f81-8d5b-4a1f-b8f0-1200dfe2a29d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:49.444554 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4efa2f81-8d5b-4a1f-b8f0-1200dfe2a29d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:49.592289 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4efa2f81-8d5b-4a1f-b8f0-1200dfe2a29d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:49.600152 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4efa2f81-8d5b-4a1f-b8f0-1200dfe2a29d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660" status: 200 len: 1318 microversion: 2.1 time: 0.174580 Dec 23 12:08:49.600696 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 511/1058] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:49 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:50.623083 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-74f4e805-24a3-458d-94c8-c45f7489880f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:50.624161 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-74f4e805-24a3-458d-94c8-c45f7489880f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:50.631543 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-74f4e805-24a3-458d-94c8-c45f7489880f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:50.631981 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-74f4e805-24a3-458d-94c8-c45f7489880f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:50.632785 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-74f4e805-24a3-458d-94c8-c45f7489880f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:50.633222 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-74f4e805-24a3-458d-94c8-c45f7489880f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:50.772492 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-74f4e805-24a3-458d-94c8-c45f7489880f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:50.782320 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-74f4e805-24a3-458d-94c8-c45f7489880f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660" status: 200 len: 1318 microversion: 2.1 time: 0.166833 Dec 23 12:08:50.783402 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 548/1059] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:50 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:51.803443 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-09390762-6a82-4db2-bacf-3e82bb764bdb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:08:51.804453 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-09390762-6a82-4db2-bacf-3e82bb764bdb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:51.815020 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-09390762-6a82-4db2-bacf-3e82bb764bdb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:51.815760 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-09390762-6a82-4db2-bacf-3e82bb764bdb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:51.817026 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-09390762-6a82-4db2-bacf-3e82bb764bdb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:51.817739 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-09390762-6a82-4db2-bacf-3e82bb764bdb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:51.968069 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-09390762-6a82-4db2-bacf-3e82bb764bdb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:08:51.980377 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-09390762-6a82-4db2-bacf-3e82bb764bdb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660" status: 200 len: 1507 microversion: 2.1 time: 0.182916 Dec 23 12:08:51.981160 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 512/1060] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:08:51 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:08:53.335377 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ffb58a11-f3df-4147-a6cb-adc27f40cbd6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94da1cf7-a006-448c-a134-7b3ba1f6ce2d"}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:08:53.336461 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ffb58a11-f3df-4147-a6cb-adc27f40cbd6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:08:53.343597 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ffb58a11-f3df-4147-a6cb-adc27f40cbd6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:53.344051 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ffb58a11-f3df-4147-a6cb-adc27f40cbd6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:53.344867 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ffb58a11-f3df-4147-a6cb-adc27f40cbd6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:08:53.345307 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ffb58a11-f3df-4147-a6cb-adc27f40cbd6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:08:53.630773 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ffb58a11-f3df-4147-a6cb-adc27f40cbd6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "POST /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299016 Dec 23 12:08:53.631409 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 549/1061] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Dec 23 12:08:53 2021] POST /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:09:01.263577 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f973a917-bd56-4900-86e1-2f6acd3670f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2004883080", "imageRef": "938a78c0-341e-4043-927a-9bfe8cf52508", "flavorRef": "452", "networks": [{"uuid": "9e6a1d94-c46e-428b-b262-4cd9011990b5"}]}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:09:01.319101 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.network.neutron [None req-f973a917-bd56-4900-86e1-2f6acd3670f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] validate_networks() for [('9e6a1d94-c46e-428b-b262-4cd9011990b5', None, None, None, None, None)] {{(pid=116355) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 12:09:01.706305 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-f973a917-bd56-4900-86e1-2f6acd3670f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Flavor limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 12:09:01.706789 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-f973a917-bd56-4900-86e1-2f6acd3670f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Image limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 12:09:01.707285 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-f973a917-bd56-4900-86e1-2f6acd3670f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Flavor pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 12:09:01.707693 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-f973a917-bd56-4900-86e1-2f6acd3670f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Image pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 12:09:01.708100 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-f973a917-bd56-4900-86e1-2f6acd3670f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 12:09:01.718940 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f973a917-bd56-4900-86e1-2f6acd3670f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:01.719386 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f973a917-bd56-4900-86e1-2f6acd3670f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:01.720195 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f973a917-bd56-4900-86e1-2f6acd3670f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:01.720601 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f973a917-bd56-4900-86e1-2f6acd3670f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:01.741910 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-f973a917-bd56-4900-86e1-2f6acd3670f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Getting quotas for project a2b2d4247c1e4c7aa7b75187a8a189f2. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:09:01.746194 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-f973a917-bd56-4900-86e1-2f6acd3670f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Getting quotas for user 48979a77dffa4ec5a51dfab475185430 and project a2b2d4247c1e4c7aa7b75187a8a189f2. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:09:01.760454 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f973a917-bd56-4900-86e1-2f6acd3670f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Going to run 1 instances... {{(pid=116355) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 12:09:01.762813 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f973a917-bd56-4900-86e1-2f6acd3670f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='938a78c0-341e-4043-927a-9bfe8cf52508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 12:09:01.811891 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f973a917-bd56-4900-86e1-2f6acd3670f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552212 Dec 23 12:09:01.814498 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 513/1062] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 12:09:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 12:09:01.825397 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7f37be39-0d9c-49ac-a2d5-867bd576ae23 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:01.826098 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-7f37be39-0d9c-49ac-a2d5-867bd576ae23 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:01.881752 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-7f37be39-0d9c-49ac-a2d5-867bd576ae23 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:01.888257 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-7f37be39-0d9c-49ac-a2d5-867bd576ae23 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079" status: 200 len: 1218 microversion: 2.1 time: 0.067564 Dec 23 12:09:01.888858 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 550/1063] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:01 2021] GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:02.905709 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b422788a-81b7-44bc-a292-7c893aebe6fa tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:02.906338 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b422788a-81b7-44bc-a292-7c893aebe6fa tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:02.913090 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b422788a-81b7-44bc-a292-7c893aebe6fa tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:02.913548 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b422788a-81b7-44bc-a292-7c893aebe6fa tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:02.914331 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b422788a-81b7-44bc-a292-7c893aebe6fa tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:02.914808 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b422788a-81b7-44bc-a292-7c893aebe6fa tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:02.979498 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b422788a-81b7-44bc-a292-7c893aebe6fa tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:02.987731 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b422788a-81b7-44bc-a292-7c893aebe6fa tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079" status: 200 len: 1270 microversion: 2.1 time: 0.086278 Dec 23 12:09:02.988728 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 514/1064] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:02 2021] GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:04.009962 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2ca0cf92-9994-4a16-a3f4-a2be83cfb3f6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:04.010762 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2ca0cf92-9994-4a16-a3f4-a2be83cfb3f6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:04.018896 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2ca0cf92-9994-4a16-a3f4-a2be83cfb3f6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:04.019573 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2ca0cf92-9994-4a16-a3f4-a2be83cfb3f6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:04.020446 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2ca0cf92-9994-4a16-a3f4-a2be83cfb3f6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:04.020884 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2ca0cf92-9994-4a16-a3f4-a2be83cfb3f6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:04.291138 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2ca0cf92-9994-4a16-a3f4-a2be83cfb3f6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:04.298781 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2ca0cf92-9994-4a16-a3f4-a2be83cfb3f6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079" status: 200 len: 1318 microversion: 2.1 time: 0.292631 Dec 23 12:09:04.299357 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 551/1065] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:04 2021] GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:04.715922 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-03e6aa77-3b83-4e9c-b9d4-61b937960faf req-cd7428c4-0032-4611-9571-6ecc2e54e531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5e71a8-206c-49c9-8008-2729897c2079", "tag": "0b2f96eb-0ee4-4c54-9f33-dcdcc99a37bd"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:09:04.717506 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:09:04.717506 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:09:04.724750 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-03e6aa77-3b83-4e9c-b9d4-61b937960faf req-cd7428c4-0032-4611-9571-6ecc2e54e531 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:04.725192 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-03e6aa77-3b83-4e9c-b9d4-61b937960faf req-cd7428c4-0032-4611-9571-6ecc2e54e531 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:04.736264 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-03e6aa77-3b83-4e9c-b9d4-61b937960faf req-cd7428c4-0032-4611-9571-6ecc2e54e531 service nova] Creating event network-changed:0b2f96eb-0ee4-4c54-9f33-dcdcc99a37bd for instance 1f5e71a8-206c-49c9-8008-2729897c2079 on hv-cinder-82282 Dec 23 12:09:04.741545 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-03e6aa77-3b83-4e9c-b9d4-61b937960faf req-cd7428c4-0032-4611-9571-6ecc2e54e531 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098349 Dec 23 12:09:04.742374 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 515/1066] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:09:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:09:05.316593 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-01db2179-8b16-4092-9c77-7bb5afa58125 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:05.317305 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-01db2179-8b16-4092-9c77-7bb5afa58125 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:05.324024 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-01db2179-8b16-4092-9c77-7bb5afa58125 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:05.324510 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-01db2179-8b16-4092-9c77-7bb5afa58125 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:05.325304 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-01db2179-8b16-4092-9c77-7bb5afa58125 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:05.325743 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-01db2179-8b16-4092-9c77-7bb5afa58125 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:05.545557 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-01db2179-8b16-4092-9c77-7bb5afa58125 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:05.553888 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-01db2179-8b16-4092-9c77-7bb5afa58125 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079" status: 200 len: 1318 microversion: 2.1 time: 0.241092 Dec 23 12:09:05.554484 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 552/1067] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:05 2021] GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:06.579547 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-cf287a98-ba48-41e3-8da2-55cd322c743b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:06.580662 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-cf287a98-ba48-41e3-8da2-55cd322c743b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:06.589604 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cf287a98-ba48-41e3-8da2-55cd322c743b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:06.590060 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cf287a98-ba48-41e3-8da2-55cd322c743b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:06.591394 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cf287a98-ba48-41e3-8da2-55cd322c743b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:06.591394 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cf287a98-ba48-41e3-8da2-55cd322c743b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:06.736232 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-cf287a98-ba48-41e3-8da2-55cd322c743b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:06.744242 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-cf287a98-ba48-41e3-8da2-55cd322c743b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079" status: 200 len: 1318 microversion: 2.1 time: 0.175850 Dec 23 12:09:06.744804 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 516/1068] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:06 2021] GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:07.764859 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a926e8d6-02dd-4fd2-8156-ad2a1ae2136b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:07.765849 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a926e8d6-02dd-4fd2-8156-ad2a1ae2136b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:07.776663 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a926e8d6-02dd-4fd2-8156-ad2a1ae2136b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:07.777424 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a926e8d6-02dd-4fd2-8156-ad2a1ae2136b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:07.778789 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a926e8d6-02dd-4fd2-8156-ad2a1ae2136b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:07.779526 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a926e8d6-02dd-4fd2-8156-ad2a1ae2136b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:07.919755 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-a926e8d6-02dd-4fd2-8156-ad2a1ae2136b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:07.928184 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a926e8d6-02dd-4fd2-8156-ad2a1ae2136b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079" status: 200 len: 1318 microversion: 2.1 time: 0.169643 Dec 23 12:09:07.928757 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 553/1069] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:07 2021] GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:08.945481 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e1ea9ead-7258-47fe-8bd0-611f190f6cb8 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:08.946077 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e1ea9ead-7258-47fe-8bd0-611f190f6cb8 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:08.952913 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e1ea9ead-7258-47fe-8bd0-611f190f6cb8 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:08.953369 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e1ea9ead-7258-47fe-8bd0-611f190f6cb8 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:08.954164 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e1ea9ead-7258-47fe-8bd0-611f190f6cb8 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:08.954638 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e1ea9ead-7258-47fe-8bd0-611f190f6cb8 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:09.086740 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e1ea9ead-7258-47fe-8bd0-611f190f6cb8 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:09.094268 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e1ea9ead-7258-47fe-8bd0-611f190f6cb8 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079" status: 200 len: 1318 microversion: 2.1 time: 0.152875 Dec 23 12:09:09.094862 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 517/1070] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:08 2021] GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:10.113441 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-cbb82aee-718d-460b-9961-baab244d5e5f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:10.114226 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-cbb82aee-718d-460b-9961-baab244d5e5f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:10.121136 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cbb82aee-718d-460b-9961-baab244d5e5f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:10.121601 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cbb82aee-718d-460b-9961-baab244d5e5f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:10.122389 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cbb82aee-718d-460b-9961-baab244d5e5f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:10.122868 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cbb82aee-718d-460b-9961-baab244d5e5f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:10.255243 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-cbb82aee-718d-460b-9961-baab244d5e5f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:10.266923 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-cbb82aee-718d-460b-9961-baab244d5e5f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079" status: 200 len: 1318 microversion: 2.1 time: 0.157895 Dec 23 12:09:10.267738 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 554/1071] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:10 2021] GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:10.981935 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-bad1dd45-7d12-4f79-9be2-5be9d514e59d req-8e9fd5aa-5005-4c25-84c7-5f518d33aae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5e71a8-206c-49c9-8008-2729897c2079", "name": "network-vif-plugged", "status": "completed", "tag": "0b2f96eb-0ee4-4c54-9f33-dcdcc99a37bd"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:09:10.983545 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:09:10.983545 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:09:10.991560 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-bad1dd45-7d12-4f79-9be2-5be9d514e59d req-8e9fd5aa-5005-4c25-84c7-5f518d33aae9 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:10.991998 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-bad1dd45-7d12-4f79-9be2-5be9d514e59d req-8e9fd5aa-5005-4c25-84c7-5f518d33aae9 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:11.005399 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-bad1dd45-7d12-4f79-9be2-5be9d514e59d req-8e9fd5aa-5005-4c25-84c7-5f518d33aae9 service nova] Creating event network-vif-plugged:0b2f96eb-0ee4-4c54-9f33-dcdcc99a37bd for instance 1f5e71a8-206c-49c9-8008-2729897c2079 on hv-cinder-82282 Dec 23 12:09:11.010582 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-bad1dd45-7d12-4f79-9be2-5be9d514e59d req-8e9fd5aa-5005-4c25-84c7-5f518d33aae9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096029 Dec 23 12:09:11.011202 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 518/1072] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:09:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:09:11.284243 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-856a45a2-7802-4334-85f3-5e65d50a5026 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:11.284848 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-856a45a2-7802-4334-85f3-5e65d50a5026 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:11.291605 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-856a45a2-7802-4334-85f3-5e65d50a5026 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:11.292056 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-856a45a2-7802-4334-85f3-5e65d50a5026 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:11.292909 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-856a45a2-7802-4334-85f3-5e65d50a5026 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:11.293337 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-856a45a2-7802-4334-85f3-5e65d50a5026 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:11.437063 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-856a45a2-7802-4334-85f3-5e65d50a5026 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:11.445640 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-856a45a2-7802-4334-85f3-5e65d50a5026 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079" status: 200 len: 1318 microversion: 2.1 time: 0.165150 Dec 23 12:09:11.446222 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 555/1073] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:11 2021] GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:12.467768 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-368a7fc6-7e87-438a-9502-d4ef1d520d3c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:12.468919 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-368a7fc6-7e87-438a-9502-d4ef1d520d3c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:12.480622 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-368a7fc6-7e87-438a-9502-d4ef1d520d3c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:12.481376 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-368a7fc6-7e87-438a-9502-d4ef1d520d3c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:12.483107 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-368a7fc6-7e87-438a-9502-d4ef1d520d3c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:12.483837 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-368a7fc6-7e87-438a-9502-d4ef1d520d3c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:12.625693 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-368a7fc6-7e87-438a-9502-d4ef1d520d3c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:12.633570 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-368a7fc6-7e87-438a-9502-d4ef1d520d3c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079" status: 200 len: 1318 microversion: 2.1 time: 0.172663 Dec 23 12:09:12.634118 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 519/1074] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:12 2021] GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:13.655867 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2c3e17f1-be91-4ed0-811e-6fb537d339e4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:13.655867 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2c3e17f1-be91-4ed0-811e-6fb537d339e4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:13.662939 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2c3e17f1-be91-4ed0-811e-6fb537d339e4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:13.663411 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2c3e17f1-be91-4ed0-811e-6fb537d339e4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:13.664203 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2c3e17f1-be91-4ed0-811e-6fb537d339e4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:13.664647 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2c3e17f1-be91-4ed0-811e-6fb537d339e4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:13.827053 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2c3e17f1-be91-4ed0-811e-6fb537d339e4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:13.835450 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2c3e17f1-be91-4ed0-811e-6fb537d339e4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079" status: 200 len: 1508 microversion: 2.1 time: 0.187741 Dec 23 12:09:13.836019 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 556/1075] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:13 2021] GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079 => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:13.852972 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-6dfed9c5-4c1e-4b4e-8b4e-e3132a3135da tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94da1cf7-a006-448c-a134-7b3ba1f6ce2d"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:09:13.854036 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-6dfed9c5-4c1e-4b4e-8b4e-e3132a3135da tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:13.863980 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6dfed9c5-4c1e-4b4e-8b4e-e3132a3135da tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:13.864447 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6dfed9c5-4c1e-4b4e-8b4e-e3132a3135da tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:13.865234 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6dfed9c5-4c1e-4b4e-8b4e-e3132a3135da tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:13.865680 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6dfed9c5-4c1e-4b4e-8b4e-e3132a3135da tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:13.946282 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-6dfed9c5-4c1e-4b4e-8b4e-e3132a3135da tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] HTTP exception thrown: Invalid volume: volume 94da1cf7-a006-448c-a134-7b3ba1f6ce2d is already attached to instances: b856ae79-8acf-4de6-bf2d-82b2fe07f660 Dec 23 12:09:13.946996 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-6dfed9c5-4c1e-4b4e-8b4e-e3132a3135da tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Returning 400 to user: Invalid volume: volume 94da1cf7-a006-448c-a134-7b3ba1f6ce2d is already attached to instances: b856ae79-8acf-4de6-bf2d-82b2fe07f660 {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:09:13.947836 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-6dfed9c5-4c1e-4b4e-8b4e-e3132a3135da tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "POST /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099943 Dec 23 12:09:13.948381 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 520/1076] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Dec 23 12:09:13 2021] POST /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 23 12:09:14.012301 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c8b84045-a393-4f28-8d02-83c45215e38c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:14.012992 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c8b84045-a393-4f28-8d02-83c45215e38c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:14.020086 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c8b84045-a393-4f28-8d02-83c45215e38c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:14.020569 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c8b84045-a393-4f28-8d02-83c45215e38c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:14.021357 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c8b84045-a393-4f28-8d02-83c45215e38c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:14.021799 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c8b84045-a393-4f28-8d02-83c45215e38c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:14.099767 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-c8b84045-a393-4f28-8d02-83c45215e38c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lazy-loading 'services' on Instance uuid b856ae79-8acf-4de6-bf2d-82b2fe07f660 {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:09:14.182315 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c8b84045-a393-4f28-8d02-83c45215e38c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660/os-volume_attachments/94da1cf7-a006-448c-a134-7b3ba1f6ce2d" status: 202 len: 0 microversion: 2.1 time: 0.175862 Dec 23 12:09:14.182884 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 557/1077] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Dec 23 12:09:14 2021] DELETE /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660/os-volume_attachments/94da1cf7-a006-448c-a134-7b3ba1f6ce2d => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:09:14.191199 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e28e984b-6180-46df-9a41-e859717ca2a0 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:14.192312 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e28e984b-6180-46df-9a41-e859717ca2a0 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:14.199215 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e28e984b-6180-46df-9a41-e859717ca2a0 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:14.199758 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e28e984b-6180-46df-9a41-e859717ca2a0 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:14.200594 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e28e984b-6180-46df-9a41-e859717ca2a0 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:14.201119 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e28e984b-6180-46df-9a41-e859717ca2a0 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:14.230930 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e28e984b-6180-46df-9a41-e859717ca2a0 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043394 Dec 23 12:09:14.231493 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 521/1078] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:09:14 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:09:15.244166 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-996c3294-235e-40cb-89ce-c5221c1659c2 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:15.245130 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-996c3294-235e-40cb-89ce-c5221c1659c2 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:15.251568 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-996c3294-235e-40cb-89ce-c5221c1659c2 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:15.252016 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-996c3294-235e-40cb-89ce-c5221c1659c2 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:15.252783 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-996c3294-235e-40cb-89ce-c5221c1659c2 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:15.253226 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-996c3294-235e-40cb-89ce-c5221c1659c2 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:15.284604 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-996c3294-235e-40cb-89ce-c5221c1659c2 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Dec 23 12:09:15.285533 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 558/1079] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:09:15 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:09:16.301046 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-aa1d0d87-2568-4cd0-a9ec-057c9e192f9f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:16.302180 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-aa1d0d87-2568-4cd0-a9ec-057c9e192f9f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:16.309578 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aa1d0d87-2568-4cd0-a9ec-057c9e192f9f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:16.310083 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aa1d0d87-2568-4cd0-a9ec-057c9e192f9f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:16.311029 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aa1d0d87-2568-4cd0-a9ec-057c9e192f9f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:16.311516 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aa1d0d87-2568-4cd0-a9ec-057c9e192f9f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:16.343199 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-aa1d0d87-2568-4cd0-a9ec-057c9e192f9f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048718 Dec 23 12:09:16.343727 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 522/1080] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:09:16 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:09:16.446493 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e732e739-cd4d-4ffc-90c8-c413b339cd73 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-709180352", "imageRef": "938a78c0-341e-4043-927a-9bfe8cf52508", "flavorRef": "452", "networks": [{"uuid": "9e6a1d94-c46e-428b-b262-4cd9011990b5"}]}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:09:16.498977 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.network.neutron [None req-e732e739-cd4d-4ffc-90c8-c413b339cd73 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] validate_networks() for [('9e6a1d94-c46e-428b-b262-4cd9011990b5', None, None, None, None, None)] {{(pid=116354) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 12:09:16.942049 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-e732e739-cd4d-4ffc-90c8-c413b339cd73 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Flavor limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 12:09:16.942751 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-e732e739-cd4d-4ffc-90c8-c413b339cd73 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Image limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 12:09:16.943474 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-e732e739-cd4d-4ffc-90c8-c413b339cd73 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Flavor pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 12:09:16.944156 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-e732e739-cd4d-4ffc-90c8-c413b339cd73 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Image pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 12:09:16.944764 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-e732e739-cd4d-4ffc-90c8-c413b339cd73 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 12:09:16.957723 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e732e739-cd4d-4ffc-90c8-c413b339cd73 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:16.958165 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e732e739-cd4d-4ffc-90c8-c413b339cd73 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:16.959007 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e732e739-cd4d-4ffc-90c8-c413b339cd73 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:16.959440 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e732e739-cd4d-4ffc-90c8-c413b339cd73 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:16.976417 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-e732e739-cd4d-4ffc-90c8-c413b339cd73 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Getting quotas for project a2b2d4247c1e4c7aa7b75187a8a189f2. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:09:16.980953 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-e732e739-cd4d-4ffc-90c8-c413b339cd73 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Getting quotas for user 48979a77dffa4ec5a51dfab475185430 and project a2b2d4247c1e4c7aa7b75187a8a189f2. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:09:16.992401 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e732e739-cd4d-4ffc-90c8-c413b339cd73 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Going to run 1 instances... {{(pid=116354) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 12:09:16.994708 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e732e739-cd4d-4ffc-90c8-c413b339cd73 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='938a78c0-341e-4043-927a-9bfe8cf52508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 12:09:17.042911 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e732e739-cd4d-4ffc-90c8-c413b339cd73 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600128 Dec 23 12:09:17.043551 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 559/1081] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 12:09:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 12:09:17.053442 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-487a3e55-ba21-465d-a6f0-a7683f916a4f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:17.054476 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-487a3e55-ba21-465d-a6f0-a7683f916a4f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:17.107883 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-487a3e55-ba21-465d-a6f0-a7683f916a4f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:17.115763 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-487a3e55-ba21-465d-a6f0-a7683f916a4f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 200 len: 1217 microversion: 2.1 time: 0.066161 Dec 23 12:09:17.116944 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 523/1082] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:17 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:18.136479 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-72fd1c8e-3a83-4ef7-859a-a98dacdab083 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:18.137591 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-72fd1c8e-3a83-4ef7-859a-a98dacdab083 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:18.144883 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-72fd1c8e-3a83-4ef7-859a-a98dacdab083 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:18.145379 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-72fd1c8e-3a83-4ef7-859a-a98dacdab083 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:18.146175 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-72fd1c8e-3a83-4ef7-859a-a98dacdab083 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:18.146642 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-72fd1c8e-3a83-4ef7-859a-a98dacdab083 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:18.209450 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-72fd1c8e-3a83-4ef7-859a-a98dacdab083 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:18.217138 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-72fd1c8e-3a83-4ef7-859a-a98dacdab083 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 200 len: 1269 microversion: 2.1 time: 0.086675 Dec 23 12:09:18.217924 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 560/1083] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:18 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 1269 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:09:19.234253 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-cec7c03e-59d3-478c-8631-8a67ea59f4b4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:19.235531 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-cec7c03e-59d3-478c-8631-8a67ea59f4b4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:19.242359 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cec7c03e-59d3-478c-8631-8a67ea59f4b4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:19.242863 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cec7c03e-59d3-478c-8631-8a67ea59f4b4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:19.243724 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cec7c03e-59d3-478c-8631-8a67ea59f4b4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:19.244242 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cec7c03e-59d3-478c-8631-8a67ea59f4b4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:19.470155 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-cec7c03e-59d3-478c-8631-8a67ea59f4b4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:19.477980 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-cec7c03e-59d3-478c-8631-8a67ea59f4b4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 200 len: 1317 microversion: 2.1 time: 0.248019 Dec 23 12:09:19.478595 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 524/1084] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:19 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:19.811267 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-83aeeaf8-6082-4f09-b151-d7ef556a6d83 req-241e1c7d-37fd-4762-940f-87fa354229d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c5e84c-5ecc-4efa-b242-1910474a9736", "tag": "7af77f11-9822-4396-a9a6-4b94ebb410ea"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:09:19.812847 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:09:19.812847 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:09:19.820855 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-83aeeaf8-6082-4f09-b151-d7ef556a6d83 req-241e1c7d-37fd-4762-940f-87fa354229d5 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:19.821325 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-83aeeaf8-6082-4f09-b151-d7ef556a6d83 req-241e1c7d-37fd-4762-940f-87fa354229d5 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:19.834543 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-83aeeaf8-6082-4f09-b151-d7ef556a6d83 req-241e1c7d-37fd-4762-940f-87fa354229d5 service nova] Creating event network-changed:7af77f11-9822-4396-a9a6-4b94ebb410ea for instance 26c5e84c-5ecc-4efa-b242-1910474a9736 on hv-cinder-82282 Dec 23 12:09:19.839512 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-83aeeaf8-6082-4f09-b151-d7ef556a6d83 req-241e1c7d-37fd-4762-940f-87fa354229d5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032123 Dec 23 12:09:19.840104 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 561/1085] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:09:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 12:09:20.495903 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a54978e2-f59c-47c7-a3f0-7b430210efef tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:20.496683 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a54978e2-f59c-47c7-a3f0-7b430210efef tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:20.503846 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a54978e2-f59c-47c7-a3f0-7b430210efef tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:20.504615 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a54978e2-f59c-47c7-a3f0-7b430210efef tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:20.505530 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a54978e2-f59c-47c7-a3f0-7b430210efef tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:20.505979 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a54978e2-f59c-47c7-a3f0-7b430210efef tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:20.668834 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a54978e2-f59c-47c7-a3f0-7b430210efef tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:20.678795 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a54978e2-f59c-47c7-a3f0-7b430210efef tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 200 len: 1317 microversion: 2.1 time: 0.186650 Dec 23 12:09:20.679354 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 525/1086] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:20 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:21.698567 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-39a551b6-01a1-42da-86f8-f12d46314cb9 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:21.699280 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-39a551b6-01a1-42da-86f8-f12d46314cb9 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:21.709442 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-39a551b6-01a1-42da-86f8-f12d46314cb9 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:21.710036 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-39a551b6-01a1-42da-86f8-f12d46314cb9 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:21.711275 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-39a551b6-01a1-42da-86f8-f12d46314cb9 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:21.711850 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-39a551b6-01a1-42da-86f8-f12d46314cb9 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:21.846297 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-39a551b6-01a1-42da-86f8-f12d46314cb9 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:21.854385 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-39a551b6-01a1-42da-86f8-f12d46314cb9 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 200 len: 1317 microversion: 2.1 time: 0.161273 Dec 23 12:09:21.855110 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 562/1087] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:21 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:22.872476 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d6031b92-a3b7-4c5c-986a-672502e46aa5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:22.873461 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d6031b92-a3b7-4c5c-986a-672502e46aa5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:22.883587 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d6031b92-a3b7-4c5c-986a-672502e46aa5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:22.884241 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d6031b92-a3b7-4c5c-986a-672502e46aa5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:22.885207 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d6031b92-a3b7-4c5c-986a-672502e46aa5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:22.885858 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d6031b92-a3b7-4c5c-986a-672502e46aa5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:23.031773 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-d6031b92-a3b7-4c5c-986a-672502e46aa5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:23.039985 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d6031b92-a3b7-4c5c-986a-672502e46aa5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 200 len: 1317 microversion: 2.1 time: 0.171586 Dec 23 12:09:23.040550 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 526/1088] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:22 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:24.061075 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-dbd1f35e-e807-48a1-a02d-cafb8ac69084 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:24.062020 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-dbd1f35e-e807-48a1-a02d-cafb8ac69084 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:24.071370 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-dbd1f35e-e807-48a1-a02d-cafb8ac69084 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:24.071910 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-dbd1f35e-e807-48a1-a02d-cafb8ac69084 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:24.072608 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-dbd1f35e-e807-48a1-a02d-cafb8ac69084 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:24.073049 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-dbd1f35e-e807-48a1-a02d-cafb8ac69084 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:24.220703 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-dbd1f35e-e807-48a1-a02d-cafb8ac69084 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:24.228507 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-dbd1f35e-e807-48a1-a02d-cafb8ac69084 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 200 len: 1317 microversion: 2.1 time: 0.173818 Dec 23 12:09:24.229076 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 563/1089] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:24 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:25.249392 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3d7649d3-c183-4cde-bed6-02c6c8fe8fee tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:25.250475 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3d7649d3-c183-4cde-bed6-02c6c8fe8fee tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:25.259151 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3d7649d3-c183-4cde-bed6-02c6c8fe8fee tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:25.259606 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3d7649d3-c183-4cde-bed6-02c6c8fe8fee tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:25.260391 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3d7649d3-c183-4cde-bed6-02c6c8fe8fee tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:25.260831 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3d7649d3-c183-4cde-bed6-02c6c8fe8fee tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:25.403432 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3d7649d3-c183-4cde-bed6-02c6c8fe8fee tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:25.411186 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3d7649d3-c183-4cde-bed6-02c6c8fe8fee tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 200 len: 1317 microversion: 2.1 time: 0.168241 Dec 23 12:09:25.411810 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 527/1090] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:25 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:26.433065 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-621ab84f-795f-4d89-b067-d515531ec773 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:26.434050 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-621ab84f-795f-4d89-b067-d515531ec773 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:26.445079 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-621ab84f-795f-4d89-b067-d515531ec773 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:26.446076 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-621ab84f-795f-4d89-b067-d515531ec773 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:26.447542 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-621ab84f-795f-4d89-b067-d515531ec773 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:26.448277 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-621ab84f-795f-4d89-b067-d515531ec773 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:26.592595 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-621ab84f-795f-4d89-b067-d515531ec773 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:26.600372 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-621ab84f-795f-4d89-b067-d515531ec773 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 200 len: 1317 microversion: 2.1 time: 0.173723 Dec 23 12:09:26.600929 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 564/1091] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:26 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:27.052296 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-9a393b9d-cfca-4b46-8db6-ddc8cceef810 req-35efe974-d4b1-4944-8f68-b7e50864d643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c5e84c-5ecc-4efa-b242-1910474a9736", "name": "network-vif-plugged", "status": "completed", "tag": "7af77f11-9822-4396-a9a6-4b94ebb410ea"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:09:27.053938 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:09:27.053938 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:09:27.061547 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-9a393b9d-cfca-4b46-8db6-ddc8cceef810 req-35efe974-d4b1-4944-8f68-b7e50864d643 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:27.062082 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-9a393b9d-cfca-4b46-8db6-ddc8cceef810 req-35efe974-d4b1-4944-8f68-b7e50864d643 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:27.075196 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-9a393b9d-cfca-4b46-8db6-ddc8cceef810 req-35efe974-d4b1-4944-8f68-b7e50864d643 service nova] Creating event network-vif-plugged:7af77f11-9822-4396-a9a6-4b94ebb410ea for instance 26c5e84c-5ecc-4efa-b242-1910474a9736 on hv-cinder-82282 Dec 23 12:09:27.080148 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-9a393b9d-cfca-4b46-8db6-ddc8cceef810 req-35efe974-d4b1-4944-8f68-b7e50864d643 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031991 Dec 23 12:09:27.080934 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 528/1092] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:09:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:09:27.626766 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-02d983b9-27c7-4c52-9179-16fb83cdb651 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:27.627410 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-02d983b9-27c7-4c52-9179-16fb83cdb651 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:27.635103 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-02d983b9-27c7-4c52-9179-16fb83cdb651 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:27.635553 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-02d983b9-27c7-4c52-9179-16fb83cdb651 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:27.636323 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-02d983b9-27c7-4c52-9179-16fb83cdb651 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:27.636757 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-02d983b9-27c7-4c52-9179-16fb83cdb651 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:27.777577 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-02d983b9-27c7-4c52-9179-16fb83cdb651 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:27.785033 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-02d983b9-27c7-4c52-9179-16fb83cdb651 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 200 len: 1317 microversion: 2.1 time: 0.164278 Dec 23 12:09:27.785602 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 565/1093] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:27 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:28.807111 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e120b877-47be-4a90-a301-3e29fea88757 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:28.808322 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e120b877-47be-4a90-a301-3e29fea88757 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:28.818950 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e120b877-47be-4a90-a301-3e29fea88757 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:28.819408 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e120b877-47be-4a90-a301-3e29fea88757 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:28.820290 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e120b877-47be-4a90-a301-3e29fea88757 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:28.820739 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e120b877-47be-4a90-a301-3e29fea88757 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:28.965083 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e120b877-47be-4a90-a301-3e29fea88757 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:28.972860 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e120b877-47be-4a90-a301-3e29fea88757 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 200 len: 1317 microversion: 2.1 time: 0.172637 Dec 23 12:09:28.973492 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 529/1094] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:28 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:29.994958 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-79b2021a-6cc4-4efc-95dc-366335ee1b3f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:29.995989 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-79b2021a-6cc4-4efc-95dc-366335ee1b3f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:30.006997 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-79b2021a-6cc4-4efc-95dc-366335ee1b3f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:30.007452 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-79b2021a-6cc4-4efc-95dc-366335ee1b3f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:30.008247 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-79b2021a-6cc4-4efc-95dc-366335ee1b3f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:30.008683 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-79b2021a-6cc4-4efc-95dc-366335ee1b3f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:30.154680 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-79b2021a-6cc4-4efc-95dc-366335ee1b3f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:30.162319 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-79b2021a-6cc4-4efc-95dc-366335ee1b3f tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 200 len: 1506 microversion: 2.1 time: 0.173623 Dec 23 12:09:30.162898 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 566/1095] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:29 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:31.494091 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-bd22a3a5-efca-4cf1-9a5c-50c01a7d89c2 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e0ad805-5782-4d3f-9221-75d2d0c05527"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:09:31.495192 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-bd22a3a5-efca-4cf1-9a5c-50c01a7d89c2 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:31.502172 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bd22a3a5-efca-4cf1-9a5c-50c01a7d89c2 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:31.502655 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bd22a3a5-efca-4cf1-9a5c-50c01a7d89c2 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:31.503443 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bd22a3a5-efca-4cf1-9a5c-50c01a7d89c2 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:31.503882 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bd22a3a5-efca-4cf1-9a5c-50c01a7d89c2 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:31.815064 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-bd22a3a5-efca-4cf1-9a5c-50c01a7d89c2 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "POST /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324853 Dec 23 12:09:31.815740 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 530/1096] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Dec 23 12:09:31 2021] POST /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:09:39.351745 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b65c60ab-5b05-4a84-8bec-c1a533c1cccc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e0ad805-5782-4d3f-9221-75d2d0c05527"}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:09:39.352805 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b65c60ab-5b05-4a84-8bec-c1a533c1cccc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:39.359842 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b65c60ab-5b05-4a84-8bec-c1a533c1cccc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:39.360136 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b65c60ab-5b05-4a84-8bec-c1a533c1cccc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:39.360913 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b65c60ab-5b05-4a84-8bec-c1a533c1cccc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:39.361342 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b65c60ab-5b05-4a84-8bec-c1a533c1cccc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:39.437825 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-b65c60ab-5b05-4a84-8bec-c1a533c1cccc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] HTTP exception thrown: Invalid volume: volume 6e0ad805-5782-4d3f-9221-75d2d0c05527 is already attached to instances: 26c5e84c-5ecc-4efa-b242-1910474a9736 Dec 23 12:09:39.438667 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b65c60ab-5b05-4a84-8bec-c1a533c1cccc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Returning 400 to user: Invalid volume: volume 6e0ad805-5782-4d3f-9221-75d2d0c05527 is already attached to instances: 26c5e84c-5ecc-4efa-b242-1910474a9736 {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:09:39.439780 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b65c60ab-5b05-4a84-8bec-c1a533c1cccc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "POST /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091836 Dec 23 12:09:39.443600 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 567/1097] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Dec 23 12:09:39 2021] POST /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 23 12:09:39.499092 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-1ccd819b-11e7-42d3-93a9-4fbbe73db968 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:39.499630 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-1ccd819b-11e7-42d3-93a9-4fbbe73db968 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:39.505798 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1ccd819b-11e7-42d3-93a9-4fbbe73db968 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:39.506252 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1ccd819b-11e7-42d3-93a9-4fbbe73db968 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:39.507079 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1ccd819b-11e7-42d3-93a9-4fbbe73db968 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:39.507518 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1ccd819b-11e7-42d3-93a9-4fbbe73db968 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:39.588611 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.objects.instance [None req-1ccd819b-11e7-42d3-93a9-4fbbe73db968 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lazy-loading 'services' on Instance uuid 26c5e84c-5ecc-4efa-b242-1910474a9736 {{(pid=116355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:09:39.670837 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-1ccd819b-11e7-42d3-93a9-4fbbe73db968 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "DELETE /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736/os-volume_attachments/6e0ad805-5782-4d3f-9221-75d2d0c05527" status: 202 len: 0 microversion: 2.1 time: 0.176478 Dec 23 12:09:39.671415 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 531/1098] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Dec 23 12:09:39 2021] DELETE /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736/os-volume_attachments/6e0ad805-5782-4d3f-9221-75d2d0c05527 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:09:39.680328 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-33b9f441-28fc-414d-8e55-f1c3c6352d09 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:39.681263 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-33b9f441-28fc-414d-8e55-f1c3c6352d09 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:39.689330 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-33b9f441-28fc-414d-8e55-f1c3c6352d09 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:39.689818 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-33b9f441-28fc-414d-8e55-f1c3c6352d09 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:39.690748 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-33b9f441-28fc-414d-8e55-f1c3c6352d09 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:39.691232 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-33b9f441-28fc-414d-8e55-f1c3c6352d09 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:39.721590 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-33b9f441-28fc-414d-8e55-f1c3c6352d09 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045617 Dec 23 12:09:39.722156 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 568/1099] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:09:39 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 12:09:40.739711 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0a495411-3c4e-43f9-8a48-d4e42a1602e1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:40.741275 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0a495411-3c4e-43f9-8a48-d4e42a1602e1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:40.749433 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0a495411-3c4e-43f9-8a48-d4e42a1602e1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:40.749875 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0a495411-3c4e-43f9-8a48-d4e42a1602e1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:40.750685 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0a495411-3c4e-43f9-8a48-d4e42a1602e1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:40.751123 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0a495411-3c4e-43f9-8a48-d4e42a1602e1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:40.780356 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0a495411-3c4e-43f9-8a48-d4e42a1602e1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048820 Dec 23 12:09:40.780894 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 532/1100] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:09:40 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:09:41.794678 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1da5b4f6-e82b-4d15-94b7-eed0b9a00d4b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:41.795617 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1da5b4f6-e82b-4d15-94b7-eed0b9a00d4b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:41.802198 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1da5b4f6-e82b-4d15-94b7-eed0b9a00d4b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:41.802691 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1da5b4f6-e82b-4d15-94b7-eed0b9a00d4b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:41.803476 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1da5b4f6-e82b-4d15-94b7-eed0b9a00d4b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:41.803909 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1da5b4f6-e82b-4d15-94b7-eed0b9a00d4b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:41.833449 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1da5b4f6-e82b-4d15-94b7-eed0b9a00d4b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044214 Dec 23 12:09:41.834018 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 569/1101] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:09:41 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:09:41.932104 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c981e973-e216-410c-8883-a26f1df319cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1834785299", "imageRef": "938a78c0-341e-4043-927a-9bfe8cf52508", "flavorRef": "452", "networks": [{"uuid": "9e6a1d94-c46e-428b-b262-4cd9011990b5"}]}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:09:41.991237 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.network.neutron [None req-c981e973-e216-410c-8883-a26f1df319cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] validate_networks() for [('9e6a1d94-c46e-428b-b262-4cd9011990b5', None, None, None, None, None)] {{(pid=116355) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 12:09:42.378816 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-c981e973-e216-410c-8883-a26f1df319cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Flavor limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 12:09:42.379245 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-c981e973-e216-410c-8883-a26f1df319cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Image limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 12:09:42.379754 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-c981e973-e216-410c-8883-a26f1df319cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Flavor pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 12:09:42.380221 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-c981e973-e216-410c-8883-a26f1df319cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Image pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 12:09:42.380637 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-c981e973-e216-410c-8883-a26f1df319cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 12:09:42.390480 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c981e973-e216-410c-8883-a26f1df319cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:42.390976 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c981e973-e216-410c-8883-a26f1df319cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:42.391829 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c981e973-e216-410c-8883-a26f1df319cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:42.392246 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c981e973-e216-410c-8883-a26f1df319cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:42.409539 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-c981e973-e216-410c-8883-a26f1df319cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Getting quotas for project a2b2d4247c1e4c7aa7b75187a8a189f2. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:09:42.414016 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-c981e973-e216-410c-8883-a26f1df319cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Getting quotas for user 48979a77dffa4ec5a51dfab475185430 and project a2b2d4247c1e4c7aa7b75187a8a189f2. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:09:42.425581 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c981e973-e216-410c-8883-a26f1df319cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Going to run 1 instances... {{(pid=116355) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 12:09:42.427885 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c981e973-e216-410c-8883-a26f1df319cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='938a78c0-341e-4043-927a-9bfe8cf52508',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 12:09:42.476560 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c981e973-e216-410c-8883-a26f1df319cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547964 Dec 23 12:09:42.477266 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 533/1102] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 12:09:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 12:09:42.487737 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-0ee21a86-1344-4045-96e5-25b12c38c236 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:42.488356 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-0ee21a86-1344-4045-96e5-25b12c38c236 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:42.544723 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-0ee21a86-1344-4045-96e5-25b12c38c236 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:42.551883 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-0ee21a86-1344-4045-96e5-25b12c38c236 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 200 len: 1218 microversion: 2.1 time: 0.067961 Dec 23 12:09:42.552484 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 570/1103] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:42 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:43.572860 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e4fddd3a-4b6b-4671-b1b8-95a793ec6995 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:43.573821 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e4fddd3a-4b6b-4671-b1b8-95a793ec6995 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:43.581143 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e4fddd3a-4b6b-4671-b1b8-95a793ec6995 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:43.581595 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e4fddd3a-4b6b-4671-b1b8-95a793ec6995 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:43.582366 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e4fddd3a-4b6b-4671-b1b8-95a793ec6995 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:43.582833 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e4fddd3a-4b6b-4671-b1b8-95a793ec6995 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:43.644255 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e4fddd3a-4b6b-4671-b1b8-95a793ec6995 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:43.651756 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e4fddd3a-4b6b-4671-b1b8-95a793ec6995 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 200 len: 1270 microversion: 2.1 time: 0.085044 Dec 23 12:09:43.652684 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 534/1104] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:43 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:44.669385 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-181d1143-bf91-4343-b145-6b0594b0ea43 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:44.671089 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-181d1143-bf91-4343-b145-6b0594b0ea43 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:44.677611 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-181d1143-bf91-4343-b145-6b0594b0ea43 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:44.678059 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-181d1143-bf91-4343-b145-6b0594b0ea43 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:44.678883 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-181d1143-bf91-4343-b145-6b0594b0ea43 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:44.679318 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-181d1143-bf91-4343-b145-6b0594b0ea43 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:44.890841 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-181d1143-bf91-4343-b145-6b0594b0ea43 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:44.898631 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-181d1143-bf91-4343-b145-6b0594b0ea43 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 200 len: 1318 microversion: 2.1 time: 0.233191 Dec 23 12:09:44.899212 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 571/1105] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:44 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:45.213349 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-1bb8761c-0823-408d-b831-9d94217cd601 req-3b56fcab-5f19-4bde-b9ce-25d15656d0ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45140cac-ad74-4de0-8d82-d3f4874f4722", "tag": "65bfe30b-73db-4e68-850b-ef1e984881c1"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:09:45.215806 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:09:45.215806 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:09:45.223973 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-1bb8761c-0823-408d-b831-9d94217cd601 req-3b56fcab-5f19-4bde-b9ce-25d15656d0ce service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:45.224424 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-1bb8761c-0823-408d-b831-9d94217cd601 req-3b56fcab-5f19-4bde-b9ce-25d15656d0ce service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:45.247976 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-1bb8761c-0823-408d-b831-9d94217cd601 req-3b56fcab-5f19-4bde-b9ce-25d15656d0ce service nova] Creating event network-changed:65bfe30b-73db-4e68-850b-ef1e984881c1 for instance 45140cac-ad74-4de0-8d82-d3f4874f4722 on hv-cinder-82282 Dec 23 12:09:45.254180 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-1bb8761c-0823-408d-b831-9d94217cd601 req-3b56fcab-5f19-4bde-b9ce-25d15656d0ce service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044640 Dec 23 12:09:45.254961 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 535/1106] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:09:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:09:45.916253 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9033a0b3-b2bd-435c-ad12-c1b47ae262c1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:45.916835 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9033a0b3-b2bd-435c-ad12-c1b47ae262c1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:45.924022 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9033a0b3-b2bd-435c-ad12-c1b47ae262c1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:45.924471 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9033a0b3-b2bd-435c-ad12-c1b47ae262c1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:45.925253 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9033a0b3-b2bd-435c-ad12-c1b47ae262c1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:45.925687 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9033a0b3-b2bd-435c-ad12-c1b47ae262c1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:46.156021 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9033a0b3-b2bd-435c-ad12-c1b47ae262c1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:46.168134 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9033a0b3-b2bd-435c-ad12-c1b47ae262c1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 200 len: 1318 microversion: 2.1 time: 0.255231 Dec 23 12:09:46.168996 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 572/1107] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:45 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:47.191009 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-70060db5-871d-4445-b9ef-71aab1243cfe tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:47.191598 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-70060db5-871d-4445-b9ef-71aab1243cfe tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:47.198340 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-70060db5-871d-4445-b9ef-71aab1243cfe tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:47.198895 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-70060db5-871d-4445-b9ef-71aab1243cfe tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:47.199805 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-70060db5-871d-4445-b9ef-71aab1243cfe tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:47.200272 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-70060db5-871d-4445-b9ef-71aab1243cfe tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:47.341545 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-70060db5-871d-4445-b9ef-71aab1243cfe tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:47.349672 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-70060db5-871d-4445-b9ef-71aab1243cfe tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 200 len: 1318 microversion: 2.1 time: 0.163479 Dec 23 12:09:47.350249 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 536/1108] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:47 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:48.371464 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-d1185f15-dbfa-4db9-af41-b948a6a35386 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:48.372538 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-d1185f15-dbfa-4db9-af41-b948a6a35386 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:48.378931 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d1185f15-dbfa-4db9-af41-b948a6a35386 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:48.379389 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d1185f15-dbfa-4db9-af41-b948a6a35386 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:48.380168 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d1185f15-dbfa-4db9-af41-b948a6a35386 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:48.380602 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-d1185f15-dbfa-4db9-af41-b948a6a35386 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:48.514314 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-d1185f15-dbfa-4db9-af41-b948a6a35386 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:48.522684 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-d1185f15-dbfa-4db9-af41-b948a6a35386 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 200 len: 1318 microversion: 2.1 time: 0.157558 Dec 23 12:09:48.523273 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 573/1109] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:48 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:49.544184 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-de876b2f-00f4-4018-a739-430286ddab1d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:49.544785 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-de876b2f-00f4-4018-a739-430286ddab1d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:49.552397 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-de876b2f-00f4-4018-a739-430286ddab1d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:49.552833 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-de876b2f-00f4-4018-a739-430286ddab1d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:49.553604 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-de876b2f-00f4-4018-a739-430286ddab1d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:49.554032 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-de876b2f-00f4-4018-a739-430286ddab1d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:49.695237 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-de876b2f-00f4-4018-a739-430286ddab1d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:49.707160 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-de876b2f-00f4-4018-a739-430286ddab1d tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 200 len: 1318 microversion: 2.1 time: 0.168891 Dec 23 12:09:49.708043 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 537/1110] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:49 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:50.724755 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-6b341596-91ce-4481-974a-5163467670d5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:50.725328 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-6b341596-91ce-4481-974a-5163467670d5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:50.732337 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6b341596-91ce-4481-974a-5163467670d5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:50.732875 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6b341596-91ce-4481-974a-5163467670d5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:50.733665 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6b341596-91ce-4481-974a-5163467670d5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:50.734104 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6b341596-91ce-4481-974a-5163467670d5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:50.885692 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-6b341596-91ce-4481-974a-5163467670d5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:50.894182 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-6b341596-91ce-4481-974a-5163467670d5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 200 len: 1318 microversion: 2.1 time: 0.173286 Dec 23 12:09:50.894766 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 574/1111] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:50 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:51.212193 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-f68e1870-41b9-43a7-8206-4647b64d2407 req-4731ccd5-b4e1-4dc0-95b0-227fc26f6c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45140cac-ad74-4de0-8d82-d3f4874f4722", "name": "network-vif-plugged", "status": "completed", "tag": "65bfe30b-73db-4e68-850b-ef1e984881c1"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:09:51.213959 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:09:51.213959 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:09:51.222172 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-f68e1870-41b9-43a7-8206-4647b64d2407 req-4731ccd5-b4e1-4dc0-95b0-227fc26f6c6a service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:51.222664 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-f68e1870-41b9-43a7-8206-4647b64d2407 req-4731ccd5-b4e1-4dc0-95b0-227fc26f6c6a service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:51.234912 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-f68e1870-41b9-43a7-8206-4647b64d2407 req-4731ccd5-b4e1-4dc0-95b0-227fc26f6c6a service nova] Creating event network-vif-plugged:65bfe30b-73db-4e68-850b-ef1e984881c1 for instance 45140cac-ad74-4de0-8d82-d3f4874f4722 on hv-cinder-82282 Dec 23 12:09:51.239967 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-f68e1870-41b9-43a7-8206-4647b64d2407 req-4731ccd5-b4e1-4dc0-95b0-227fc26f6c6a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031657 Dec 23 12:09:51.240548 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 538/1112] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:09:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:09:51.915301 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-329ef53c-e3a9-4584-8872-63beb8538023 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:51.916210 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-329ef53c-e3a9-4584-8872-63beb8538023 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:51.927220 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-329ef53c-e3a9-4584-8872-63beb8538023 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:51.927975 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-329ef53c-e3a9-4584-8872-63beb8538023 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:51.929260 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-329ef53c-e3a9-4584-8872-63beb8538023 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:51.929987 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-329ef53c-e3a9-4584-8872-63beb8538023 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:52.072373 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-329ef53c-e3a9-4584-8872-63beb8538023 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:52.080112 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-329ef53c-e3a9-4584-8872-63beb8538023 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 200 len: 1318 microversion: 2.1 time: 0.171127 Dec 23 12:09:52.080685 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 575/1113] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:51 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:53.102944 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-313b25b2-3b5f-4227-8cf4-4f88680be5e9 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:53.104106 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-313b25b2-3b5f-4227-8cf4-4f88680be5e9 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:53.112126 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-313b25b2-3b5f-4227-8cf4-4f88680be5e9 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:53.112574 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-313b25b2-3b5f-4227-8cf4-4f88680be5e9 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:53.113350 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-313b25b2-3b5f-4227-8cf4-4f88680be5e9 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:53.113787 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-313b25b2-3b5f-4227-8cf4-4f88680be5e9 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:53.256803 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-313b25b2-3b5f-4227-8cf4-4f88680be5e9 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:53.266267 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-313b25b2-3b5f-4227-8cf4-4f88680be5e9 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 200 len: 1318 microversion: 2.1 time: 0.170913 Dec 23 12:09:53.266883 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 539/1114] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:53 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:54.293897 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-eee43246-5979-415e-9d07-d391350d2b52 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:09:54.294985 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-eee43246-5979-415e-9d07-d391350d2b52 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:54.305766 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-eee43246-5979-415e-9d07-d391350d2b52 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:54.306552 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-eee43246-5979-415e-9d07-d391350d2b52 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:54.307899 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-eee43246-5979-415e-9d07-d391350d2b52 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:54.308622 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-eee43246-5979-415e-9d07-d391350d2b52 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:54.441211 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-eee43246-5979-415e-9d07-d391350d2b52 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:09:54.453181 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-eee43246-5979-415e-9d07-d391350d2b52 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 200 len: 1508 microversion: 2.1 time: 0.165105 Dec 23 12:09:54.453833 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 576/1115] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:09:54 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:09:55.793291 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3670fe7f-28be-4363-8fdb-3da209dcde55 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d75f0012-c50b-4206-88db-2dc75b546211"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:09:55.794359 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3670fe7f-28be-4363-8fdb-3da209dcde55 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:09:55.801067 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3670fe7f-28be-4363-8fdb-3da209dcde55 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:55.801523 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3670fe7f-28be-4363-8fdb-3da209dcde55 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:55.802305 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3670fe7f-28be-4363-8fdb-3da209dcde55 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:09:55.802808 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3670fe7f-28be-4363-8fdb-3da209dcde55 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:09:56.141677 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3670fe7f-28be-4363-8fdb-3da209dcde55 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "POST /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352034 Dec 23 12:09:56.142284 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 540/1116] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Dec 23 12:09:55 2021] POST /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722/os-volume_attachments => generated 194 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:10:04.812929 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-aa65dd03-4bee-47d5-b3ab-ea77752effa1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:04.813505 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-aa65dd03-4bee-47d5-b3ab-ea77752effa1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:04.819820 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aa65dd03-4bee-47d5-b3ab-ea77752effa1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:04.820284 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aa65dd03-4bee-47d5-b3ab-ea77752effa1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:04.821055 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aa65dd03-4bee-47d5-b3ab-ea77752effa1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:04.821496 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aa65dd03-4bee-47d5-b3ab-ea77752effa1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:04.898256 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-aa65dd03-4bee-47d5-b3ab-ea77752effa1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lazy-loading 'services' on Instance uuid 45140cac-ad74-4de0-8d82-d3f4874f4722 {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:10:04.970114 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-aa65dd03-4bee-47d5-b3ab-ea77752effa1 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "DELETE /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722/os-volume_attachments/d75f0012-c50b-4206-88db-2dc75b546211" status: 202 len: 0 microversion: 2.1 time: 0.160709 Dec 23 12:10:04.970789 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 577/1117] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Dec 23 12:10:04 2021] DELETE /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722/os-volume_attachments/d75f0012-c50b-4206-88db-2dc75b546211 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:10:04.980252 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-55ceba26-0710-473f-9803-f1e5caf5f1bb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:04.981255 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-55ceba26-0710-473f-9803-f1e5caf5f1bb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:04.988311 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-55ceba26-0710-473f-9803-f1e5caf5f1bb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:04.988755 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-55ceba26-0710-473f-9803-f1e5caf5f1bb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:04.989505 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-55ceba26-0710-473f-9803-f1e5caf5f1bb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:04.989968 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-55ceba26-0710-473f-9803-f1e5caf5f1bb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:05.019820 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-55ceba26-0710-473f-9803-f1e5caf5f1bb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044193 Dec 23 12:10:05.023918 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 541/1118] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:10:04 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 12:10:06.034325 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3863e351-a3c8-4978-8a24-2146483b471a tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:06.035437 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3863e351-a3c8-4978-8a24-2146483b471a tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:06.041819 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3863e351-a3c8-4978-8a24-2146483b471a tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:06.042273 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3863e351-a3c8-4978-8a24-2146483b471a tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:06.043086 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3863e351-a3c8-4978-8a24-2146483b471a tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:06.043527 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3863e351-a3c8-4978-8a24-2146483b471a tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:06.072740 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3863e351-a3c8-4978-8a24-2146483b471a tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044348 Dec 23 12:10:06.073310 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 578/1119] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:10:06 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:10:07.088465 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-868a7be5-9bad-43eb-abe5-478107310941 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:07.090034 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-868a7be5-9bad-43eb-abe5-478107310941 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:07.099034 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-868a7be5-9bad-43eb-abe5-478107310941 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:07.099484 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-868a7be5-9bad-43eb-abe5-478107310941 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:07.100262 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-868a7be5-9bad-43eb-abe5-478107310941 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:07.100695 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-868a7be5-9bad-43eb-abe5-478107310941 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:07.131675 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-868a7be5-9bad-43eb-abe5-478107310941 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049520 Dec 23 12:10:07.132238 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 542/1120] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:10:07 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:10:08.335665 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-fa3b9a9c-e3e5-432e-9827-04f65b912aeb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:08.336185 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-fa3b9a9c-e3e5-432e-9827-04f65b912aeb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:08.342805 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fa3b9a9c-e3e5-432e-9827-04f65b912aeb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:08.343253 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fa3b9a9c-e3e5-432e-9827-04f65b912aeb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:08.344035 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fa3b9a9c-e3e5-432e-9827-04f65b912aeb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:08.344454 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fa3b9a9c-e3e5-432e-9827-04f65b912aeb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:08.372109 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-fa3b9a9c-e3e5-432e-9827-04f65b912aeb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Going to try to terminate instance {{(pid=116354) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:10:08.454325 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-fa3b9a9c-e3e5-432e-9827-04f65b912aeb tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "DELETE /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 204 len: 0 microversion: 2.1 time: 0.121988 Dec 23 12:10:08.455065 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 579/1121] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:10:08 2021] DELETE /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:10:08.464317 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e0932aff-8165-4e2b-9c94-2f4a5ff3dde3 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:08.465015 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e0932aff-8165-4e2b-9c94-2f4a5ff3dde3 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:08.473949 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e0932aff-8165-4e2b-9c94-2f4a5ff3dde3 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:08.474444 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e0932aff-8165-4e2b-9c94-2f4a5ff3dde3 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:08.475262 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e0932aff-8165-4e2b-9c94-2f4a5ff3dde3 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:08.475696 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e0932aff-8165-4e2b-9c94-2f4a5ff3dde3 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:08.885081 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e0932aff-8165-4e2b-9c94-2f4a5ff3dde3 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:08.894825 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e0932aff-8165-4e2b-9c94-2f4a5ff3dde3 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 200 len: 1514 microversion: 2.1 time: 0.435198 Dec 23 12:10:08.895400 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 543/1122] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:08 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 1514 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:09.922808 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a185db92-803c-4a02-8a6c-099cc8bda913 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:09.923973 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a185db92-803c-4a02-8a6c-099cc8bda913 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:09.935358 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a185db92-803c-4a02-8a6c-099cc8bda913 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:09.936121 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a185db92-803c-4a02-8a6c-099cc8bda913 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:09.937455 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a185db92-803c-4a02-8a6c-099cc8bda913 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:09.938151 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a185db92-803c-4a02-8a6c-099cc8bda913 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:10.082641 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-a185db92-803c-4a02-8a6c-099cc8bda913 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:10.090872 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a185db92-803c-4a02-8a6c-099cc8bda913 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 200 len: 1514 microversion: 2.1 time: 0.174868 Dec 23 12:10:10.091448 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 580/1123] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:09 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:11.111816 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-be321666-0341-4f07-a060-f254a21464cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:11.112838 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-be321666-0341-4f07-a060-f254a21464cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:11.119930 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-be321666-0341-4f07-a060-f254a21464cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:11.120385 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-be321666-0341-4f07-a060-f254a21464cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:11.121179 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-be321666-0341-4f07-a060-f254a21464cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:11.121618 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-be321666-0341-4f07-a060-f254a21464cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:11.339972 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-be321666-0341-4f07-a060-f254a21464cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:11.350214 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-be321666-0341-4f07-a060-f254a21464cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 200 len: 1514 microversion: 2.1 time: 0.244986 Dec 23 12:10:11.351220 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 544/1124] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:11 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:11.722772 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-528d861e-d10e-4415-9013-ded0164d3f8d req-96807f6c-3ac5-4197-9c33-7475b71952a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45140cac-ad74-4de0-8d82-d3f4874f4722", "name": "network-vif-deleted", "tag": "65bfe30b-73db-4e68-850b-ef1e984881c1"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:10:11.726075 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:10:11.726075 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:10:11.736113 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-528d861e-d10e-4415-9013-ded0164d3f8d req-96807f6c-3ac5-4197-9c33-7475b71952a7 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:11.736565 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-528d861e-d10e-4415-9013-ded0164d3f8d req-96807f6c-3ac5-4197-9c33-7475b71952a7 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:11.748556 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-528d861e-d10e-4415-9013-ded0164d3f8d req-96807f6c-3ac5-4197-9c33-7475b71952a7 service nova] Creating event network-vif-deleted:65bfe30b-73db-4e68-850b-ef1e984881c1 for instance 45140cac-ad74-4de0-8d82-d3f4874f4722 on hv-cinder-82282 Dec 23 12:10:11.753200 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-528d861e-d10e-4415-9013-ded0164d3f8d req-96807f6c-3ac5-4197-9c33-7475b71952a7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034495 Dec 23 12:10:11.753807 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 581/1125] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:10:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:10:12.372156 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-dc421ac0-9843-43b9-be18-9aa93e835c1b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:12.373188 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-dc421ac0-9843-43b9-be18-9aa93e835c1b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:12.382856 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dc421ac0-9843-43b9-be18-9aa93e835c1b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:12.383313 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dc421ac0-9843-43b9-be18-9aa93e835c1b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:12.384125 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dc421ac0-9843-43b9-be18-9aa93e835c1b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:12.384578 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dc421ac0-9843-43b9-be18-9aa93e835c1b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:12.416551 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dc421ac0-9843-43b9-be18-9aa93e835c1b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:12.417002 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-dc421ac0-9843-43b9-be18-9aa93e835c1b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:12.417455 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.objects.instance [None req-dc421ac0-9843-43b9-be18-9aa93e835c1b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lazy-loading 'fault' on Instance uuid 45140cac-ad74-4de0-8d82-d3f4874f4722 {{(pid=116355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:10:12.457377 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-dc421ac0-9843-43b9-be18-9aa93e835c1b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:12.465113 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-dc421ac0-9843-43b9-be18-9aa93e835c1b tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 200 len: 1308 microversion: 2.1 time: 0.099230 Dec 23 12:10:12.465875 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 545/1126] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:12 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:13.488173 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-39f55cd5-88fe-487e-b328-83b001252331 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:13.489606 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-39f55cd5-88fe-487e-b328-83b001252331 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 45140cac-ad74-4de0-8d82-d3f4874f4722] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:13.500316 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-39f55cd5-88fe-487e-b328-83b001252331 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:13.501071 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-39f55cd5-88fe-487e-b328-83b001252331 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:13.502364 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-39f55cd5-88fe-487e-b328-83b001252331 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:13.503169 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-39f55cd5-88fe-487e-b328-83b001252331 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:13.517235 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-39f55cd5-88fe-487e-b328-83b001252331 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] HTTP exception thrown: Instance 45140cac-ad74-4de0-8d82-d3f4874f4722 could not be found. Dec 23 12:10:13.517822 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-39f55cd5-88fe-487e-b328-83b001252331 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Returning 404 to user: Instance 45140cac-ad74-4de0-8d82-d3f4874f4722 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:10:13.518673 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-39f55cd5-88fe-487e-b328-83b001252331 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722" status: 404 len: 111 microversion: 2.1 time: 0.038568 Dec 23 12:10:13.519196 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 582/1127] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:13 2021] GET /compute/v2.1/servers/45140cac-ad74-4de0-8d82-d3f4874f4722 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:10:14.659628 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d37b097d-0e10-4cf4-a0ec-5e174c757105 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:14.660137 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d37b097d-0e10-4cf4-a0ec-5e174c757105 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:14.667192 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d37b097d-0e10-4cf4-a0ec-5e174c757105 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:14.667648 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d37b097d-0e10-4cf4-a0ec-5e174c757105 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:14.668439 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d37b097d-0e10-4cf4-a0ec-5e174c757105 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:14.668879 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d37b097d-0e10-4cf4-a0ec-5e174c757105 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:14.694111 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d37b097d-0e10-4cf4-a0ec-5e174c757105 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Going to try to terminate instance {{(pid=116355) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:10:14.779857 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d37b097d-0e10-4cf4-a0ec-5e174c757105 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "DELETE /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 204 len: 0 microversion: 2.1 time: 0.123698 Dec 23 12:10:14.780863 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 546/1128] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:10:14 2021] DELETE /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 23 12:10:14.789382 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-91b26942-6622-4bec-9f62-7116ab021362 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:14.789999 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-91b26942-6622-4bec-9f62-7116ab021362 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:14.796137 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-91b26942-6622-4bec-9f62-7116ab021362 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:14.796583 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-91b26942-6622-4bec-9f62-7116ab021362 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:14.797379 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-91b26942-6622-4bec-9f62-7116ab021362 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:14.797815 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-91b26942-6622-4bec-9f62-7116ab021362 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:14.960250 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-91b26942-6622-4bec-9f62-7116ab021362 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:14.974835 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-91b26942-6622-4bec-9f62-7116ab021362 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 200 len: 1512 microversion: 2.1 time: 0.189420 Dec 23 12:10:14.975389 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 583/1129] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:14 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:15.997891 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ae44e0b6-a424-464a-83a3-ab06c13bcad5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:15.998625 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ae44e0b6-a424-464a-83a3-ab06c13bcad5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:16.006181 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ae44e0b6-a424-464a-83a3-ab06c13bcad5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:16.006734 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ae44e0b6-a424-464a-83a3-ab06c13bcad5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:16.007724 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ae44e0b6-a424-464a-83a3-ab06c13bcad5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:16.008160 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ae44e0b6-a424-464a-83a3-ab06c13bcad5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:16.148244 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ae44e0b6-a424-464a-83a3-ab06c13bcad5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:16.156526 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ae44e0b6-a424-464a-83a3-ab06c13bcad5 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 200 len: 1512 microversion: 2.1 time: 0.165745 Dec 23 12:10:16.157102 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 547/1130] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:15 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:17.174035 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-099411fb-9d22-47d5-b0f0-792b1e7e7090 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:17.174587 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-099411fb-9d22-47d5-b0f0-792b1e7e7090 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:17.181946 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-099411fb-9d22-47d5-b0f0-792b1e7e7090 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:17.182401 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-099411fb-9d22-47d5-b0f0-792b1e7e7090 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:17.183258 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-099411fb-9d22-47d5-b0f0-792b1e7e7090 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:17.183690 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-099411fb-9d22-47d5-b0f0-792b1e7e7090 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:17.373510 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-099411fb-9d22-47d5-b0f0-792b1e7e7090 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:17.381411 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-099411fb-9d22-47d5-b0f0-792b1e7e7090 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 200 len: 1512 microversion: 2.1 time: 0.211231 Dec 23 12:10:17.381953 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 584/1131] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:17 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 1512 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:17.730113 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-580babce-a15c-4e6b-8173-3d19f666c870 req-26b789c7-0fcb-4b78-b671-44a0056505d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c5e84c-5ecc-4efa-b242-1910474a9736", "name": "network-vif-deleted", "tag": "7af77f11-9822-4396-a9a6-4b94ebb410ea"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:10:17.733177 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:10:17.733177 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:10:17.741835 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-580babce-a15c-4e6b-8173-3d19f666c870 req-26b789c7-0fcb-4b78-b671-44a0056505d4 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:17.742283 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-580babce-a15c-4e6b-8173-3d19f666c870 req-26b789c7-0fcb-4b78-b671-44a0056505d4 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:17.753295 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-580babce-a15c-4e6b-8173-3d19f666c870 req-26b789c7-0fcb-4b78-b671-44a0056505d4 service nova] Creating event network-vif-deleted:7af77f11-9822-4396-a9a6-4b94ebb410ea for instance 26c5e84c-5ecc-4efa-b242-1910474a9736 on hv-cinder-82282 Dec 23 12:10:17.758118 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-580babce-a15c-4e6b-8173-3d19f666c870 req-26b789c7-0fcb-4b78-b671-44a0056505d4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031935 Dec 23 12:10:17.759140 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 548/1132] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:10:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:10:18.398618 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-37a405a6-7467-4751-9ebe-6b0abcc7554c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:18.399242 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-37a405a6-7467-4751-9ebe-6b0abcc7554c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 26c5e84c-5ecc-4efa-b242-1910474a9736] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:18.406296 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-37a405a6-7467-4751-9ebe-6b0abcc7554c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:18.406785 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-37a405a6-7467-4751-9ebe-6b0abcc7554c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:18.407603 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-37a405a6-7467-4751-9ebe-6b0abcc7554c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:18.408040 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-37a405a6-7467-4751-9ebe-6b0abcc7554c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:18.421716 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-37a405a6-7467-4751-9ebe-6b0abcc7554c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] HTTP exception thrown: Instance 26c5e84c-5ecc-4efa-b242-1910474a9736 could not be found. Dec 23 12:10:18.422310 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-37a405a6-7467-4751-9ebe-6b0abcc7554c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Returning 404 to user: Instance 26c5e84c-5ecc-4efa-b242-1910474a9736 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:10:18.423209 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-37a405a6-7467-4751-9ebe-6b0abcc7554c tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736" status: 404 len: 111 microversion: 2.1 time: 0.028573 Dec 23 12:10:18.423758 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 585/1133] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:18 2021] GET /compute/v2.1/servers/26c5e84c-5ecc-4efa-b242-1910474a9736 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:10:18.432543 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-11bfd96a-28b3-4fa8-9696-8e033d892252 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:18.433123 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-11bfd96a-28b3-4fa8-9696-8e033d892252 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:18.439593 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-11bfd96a-28b3-4fa8-9696-8e033d892252 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:18.440074 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-11bfd96a-28b3-4fa8-9696-8e033d892252 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:18.440894 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-11bfd96a-28b3-4fa8-9696-8e033d892252 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:18.441625 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-11bfd96a-28b3-4fa8-9696-8e033d892252 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:18.466250 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-11bfd96a-28b3-4fa8-9696-8e033d892252 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Going to try to terminate instance {{(pid=116355) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:10:18.550892 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-11bfd96a-28b3-4fa8-9696-8e033d892252 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "DELETE /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079" status: 204 len: 0 microversion: 2.1 time: 0.122029 Dec 23 12:10:18.551540 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 549/1134] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:10:18 2021] DELETE /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:10:18.560932 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-6fe9aa97-d209-436a-b30a-b05da25154f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:18.561560 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-6fe9aa97-d209-436a-b30a-b05da25154f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:18.568136 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6fe9aa97-d209-436a-b30a-b05da25154f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:18.568598 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6fe9aa97-d209-436a-b30a-b05da25154f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:18.569385 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6fe9aa97-d209-436a-b30a-b05da25154f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:18.569826 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-6fe9aa97-d209-436a-b30a-b05da25154f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:18.727181 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-6fe9aa97-d209-436a-b30a-b05da25154f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:18.736571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-6fe9aa97-d209-436a-b30a-b05da25154f7 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079" status: 200 len: 1514 microversion: 2.1 time: 0.180244 Dec 23 12:10:18.737299 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 586/1135] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:18 2021] GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:19.766859 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3d477313-704a-480c-9ecd-a1ba7c4ccfdf tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:19.767849 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3d477313-704a-480c-9ecd-a1ba7c4ccfdf tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:19.781204 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3d477313-704a-480c-9ecd-a1ba7c4ccfdf tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:19.781956 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3d477313-704a-480c-9ecd-a1ba7c4ccfdf tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:19.783365 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3d477313-704a-480c-9ecd-a1ba7c4ccfdf tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:19.784059 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3d477313-704a-480c-9ecd-a1ba7c4ccfdf tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:19.934675 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-3d477313-704a-480c-9ecd-a1ba7c4ccfdf tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:19.942148 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3d477313-704a-480c-9ecd-a1ba7c4ccfdf tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079" status: 200 len: 1514 microversion: 2.1 time: 0.184217 Dec 23 12:10:19.942748 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 550/1136] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:19 2021] GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:20.939244 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-380e9d89-dbea-4d54-bd15-cc85c6bb385c req-5c9748eb-d9ae-4b5c-abeb-345a56a6947e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5e71a8-206c-49c9-8008-2729897c2079", "name": "network-vif-deleted", "tag": "0b2f96eb-0ee4-4c54-9f33-dcdcc99a37bd"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:10:20.941078 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:10:20.941078 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:10:20.949470 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-380e9d89-dbea-4d54-bd15-cc85c6bb385c req-5c9748eb-d9ae-4b5c-abeb-345a56a6947e service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:20.949920 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-380e9d89-dbea-4d54-bd15-cc85c6bb385c req-5c9748eb-d9ae-4b5c-abeb-345a56a6947e service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:20.959350 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-99cdf619-d080-4682-9b7b-66f82e0b08ee tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:20.959996 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-99cdf619-d080-4682-9b7b-66f82e0b08ee tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:20.963401 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-380e9d89-dbea-4d54-bd15-cc85c6bb385c req-5c9748eb-d9ae-4b5c-abeb-345a56a6947e service nova] Creating event network-vif-deleted:0b2f96eb-0ee4-4c54-9f33-dcdcc99a37bd for instance 1f5e71a8-206c-49c9-8008-2729897c2079 on hv-cinder-82282 Dec 23 12:10:20.966118 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-99cdf619-d080-4682-9b7b-66f82e0b08ee tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:20.966627 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-99cdf619-d080-4682-9b7b-66f82e0b08ee tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:20.967391 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-99cdf619-d080-4682-9b7b-66f82e0b08ee tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:20.967825 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-99cdf619-d080-4682-9b7b-66f82e0b08ee tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:20.969015 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-380e9d89-dbea-4d54-bd15-cc85c6bb385c req-5c9748eb-d9ae-4b5c-abeb-345a56a6947e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033507 Dec 23 12:10:20.970263 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 587/1137] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:10:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:10:21.032274 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-99cdf619-d080-4682-9b7b-66f82e0b08ee tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:21.040393 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-99cdf619-d080-4682-9b7b-66f82e0b08ee tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079" status: 200 len: 1472 microversion: 2.1 time: 0.084969 Dec 23 12:10:21.042565 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 551/1138] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:20 2021] GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079 => generated 1472 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:22.058852 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4b3681a9-5ecc-4916-85c9-52caff5432d6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:22.059548 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4b3681a9-5ecc-4916-85c9-52caff5432d6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: 1f5e71a8-206c-49c9-8008-2729897c2079] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:22.065839 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4b3681a9-5ecc-4916-85c9-52caff5432d6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:22.066287 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4b3681a9-5ecc-4916-85c9-52caff5432d6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:22.067566 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4b3681a9-5ecc-4916-85c9-52caff5432d6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:22.068046 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4b3681a9-5ecc-4916-85c9-52caff5432d6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:22.081981 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-4b3681a9-5ecc-4916-85c9-52caff5432d6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] HTTP exception thrown: Instance 1f5e71a8-206c-49c9-8008-2729897c2079 could not be found. Dec 23 12:10:22.082769 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4b3681a9-5ecc-4916-85c9-52caff5432d6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Returning 404 to user: Instance 1f5e71a8-206c-49c9-8008-2729897c2079 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:10:22.083586 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4b3681a9-5ecc-4916-85c9-52caff5432d6 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079" status: 404 len: 111 microversion: 2.1 time: 0.029498 Dec 23 12:10:22.084107 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 588/1139] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:22 2021] GET /compute/v2.1/servers/1f5e71a8-206c-49c9-8008-2729897c2079 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:10:23.231046 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0484d3f3-61a4-4e2e-8e87-e699bf05fbcd tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:23.231620 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0484d3f3-61a4-4e2e-8e87-e699bf05fbcd tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:23.238863 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0484d3f3-61a4-4e2e-8e87-e699bf05fbcd tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:23.239326 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0484d3f3-61a4-4e2e-8e87-e699bf05fbcd tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:23.240113 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0484d3f3-61a4-4e2e-8e87-e699bf05fbcd tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:23.240553 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0484d3f3-61a4-4e2e-8e87-e699bf05fbcd tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:23.266056 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0484d3f3-61a4-4e2e-8e87-e699bf05fbcd tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Going to try to terminate instance {{(pid=116355) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:10:23.341591 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0484d3f3-61a4-4e2e-8e87-e699bf05fbcd tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660" status: 204 len: 0 microversion: 2.1 time: 0.114024 Dec 23 12:10:23.342234 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 552/1140] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:10:23 2021] DELETE /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:10:23.351414 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8c9a571b-32d9-436e-a1da-a99389d75875 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:23.352058 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8c9a571b-32d9-436e-a1da-a99389d75875 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:23.359396 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8c9a571b-32d9-436e-a1da-a99389d75875 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:23.359858 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8c9a571b-32d9-436e-a1da-a99389d75875 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:23.360652 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8c9a571b-32d9-436e-a1da-a99389d75875 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:23.361093 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8c9a571b-32d9-436e-a1da-a99389d75875 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:23.496386 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8c9a571b-32d9-436e-a1da-a99389d75875 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:23.503860 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8c9a571b-32d9-436e-a1da-a99389d75875 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660" status: 200 len: 1513 microversion: 2.1 time: 0.156973 Dec 23 12:10:23.504423 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 589/1141] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:23 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:24.524919 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-65dc4408-f46c-4de0-81f7-47f02f35d4f4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:24.525622 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-65dc4408-f46c-4de0-81f7-47f02f35d4f4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:24.532074 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-65dc4408-f46c-4de0-81f7-47f02f35d4f4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:24.532525 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-65dc4408-f46c-4de0-81f7-47f02f35d4f4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:24.533303 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-65dc4408-f46c-4de0-81f7-47f02f35d4f4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:24.533739 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-65dc4408-f46c-4de0-81f7-47f02f35d4f4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:24.679431 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-65dc4408-f46c-4de0-81f7-47f02f35d4f4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:24.691727 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-65dc4408-f46c-4de0-81f7-47f02f35d4f4 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660" status: 200 len: 1513 microversion: 2.1 time: 0.171749 Dec 23 12:10:24.692836 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 553/1142] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:24 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:25.709652 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e2b3a15e-838f-428e-9eb5-d7757a442d97 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:25.710261 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e2b3a15e-838f-428e-9eb5-d7757a442d97 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:25.716264 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2b3a15e-838f-428e-9eb5-d7757a442d97 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:25.716714 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2b3a15e-838f-428e-9eb5-d7757a442d97 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:25.717499 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2b3a15e-838f-428e-9eb5-d7757a442d97 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:25.717938 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e2b3a15e-838f-428e-9eb5-d7757a442d97 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:25.928054 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e2b3a15e-838f-428e-9eb5-d7757a442d97 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48979a77dffa4ec5a51dfab475185430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:25.935761 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e2b3a15e-838f-428e-9eb5-d7757a442d97 tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660" status: 200 len: 1513 microversion: 2.1 time: 0.230172 Dec 23 12:10:25.936354 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 590/1143] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:25 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660 => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:10:26.060226 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-ec2d183a-2a33-4b88-b350-68702c959637 req-8526911d-7596-42e3-8486-20f0ce3ccaaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b856ae79-8acf-4de6-bf2d-82b2fe07f660", "name": "network-vif-deleted", "tag": "53da5b0d-4c2f-49b5-9f52-322e6cf44b13"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:10:26.061779 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:10:26.061779 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:10:26.069946 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-ec2d183a-2a33-4b88-b350-68702c959637 req-8526911d-7596-42e3-8486-20f0ce3ccaaa service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:26.070434 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-ec2d183a-2a33-4b88-b350-68702c959637 req-8526911d-7596-42e3-8486-20f0ce3ccaaa service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:26.081690 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-ec2d183a-2a33-4b88-b350-68702c959637 req-8526911d-7596-42e3-8486-20f0ce3ccaaa service nova] Creating event network-vif-deleted:53da5b0d-4c2f-49b5-9f52-322e6cf44b13 for instance b856ae79-8acf-4de6-bf2d-82b2fe07f660 on hv-cinder-82282 Dec 23 12:10:26.086585 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-ec2d183a-2a33-4b88-b350-68702c959637 req-8526911d-7596-42e3-8486-20f0ce3ccaaa service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030535 Dec 23 12:10:26.087182 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 554/1144] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:10:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:10:26.960360 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-82f7de4b-a82a-4d1b-ab37-6de83af034cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:26.961485 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-82f7de4b-a82a-4d1b-ab37-6de83af034cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] [instance: b856ae79-8acf-4de6-bf2d-82b2fe07f660] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:26.972117 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-82f7de4b-a82a-4d1b-ab37-6de83af034cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:26.972857 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-82f7de4b-a82a-4d1b-ab37-6de83af034cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:26.974184 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-82f7de4b-a82a-4d1b-ab37-6de83af034cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:26.974963 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-82f7de4b-a82a-4d1b-ab37-6de83af034cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:26.989198 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-82f7de4b-a82a-4d1b-ab37-6de83af034cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] HTTP exception thrown: Instance b856ae79-8acf-4de6-bf2d-82b2fe07f660 could not be found. Dec 23 12:10:26.989790 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-82f7de4b-a82a-4d1b-ab37-6de83af034cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] Returning 404 to user: Instance b856ae79-8acf-4de6-bf2d-82b2fe07f660 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:10:26.990625 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-82f7de4b-a82a-4d1b-ab37-6de83af034cc tempest-AttachVolumeNegativeTest-1530291395 tempest-AttachVolumeNegativeTest-1530291395-project] 10.222.0.65 "GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660" status: 404 len: 111 microversion: 2.1 time: 0.036712 Dec 23 12:10:26.991195 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 591/1145] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:26 2021] GET /compute/v2.1/servers/b856ae79-8acf-4de6-bf2d-82b2fe07f660 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:10:45.036191 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-57276386-a89c-4ef2-826d-99caa8f1b4a7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:45.036789 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-57276386-a89c-4ef2-826d-99caa8f1b4a7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:45.043422 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-57276386-a89c-4ef2-826d-99caa8f1b4a7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:45.044043 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-57276386-a89c-4ef2-826d-99caa8f1b4a7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:45.044838 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-57276386-a89c-4ef2-826d-99caa8f1b4a7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:45.045285 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-57276386-a89c-4ef2-826d-99caa8f1b4a7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:45.070904 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-57276386-a89c-4ef2-826d-99caa8f1b4a7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Going to try to terminate instance {{(pid=116355) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:10:45.153804 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-57276386-a89c-4ef2-826d-99caa8f1b4a7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 204 len: 0 microversion: 2.1 time: 0.121765 Dec 23 12:10:45.155501 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 555/1146] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:10:45 2021] DELETE /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:10:45.163671 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-92768aea-0a5b-4cd6-b112-4cb2931862f5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:45.165822 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-92768aea-0a5b-4cd6-b112-4cb2931862f5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:45.170706 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-92768aea-0a5b-4cd6-b112-4cb2931862f5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:45.171170 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-92768aea-0a5b-4cd6-b112-4cb2931862f5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:45.171952 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-92768aea-0a5b-4cd6-b112-4cb2931862f5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:45.172391 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-92768aea-0a5b-4cd6-b112-4cb2931862f5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:45.314018 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-92768aea-0a5b-4cd6-b112-4cb2931862f5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:45.322712 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-92768aea-0a5b-4cd6-b112-4cb2931862f5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1575 microversion: 2.1 time: 0.162776 Dec 23 12:10:45.323279 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 592/1147] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:45 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:46.340593 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-6c0b08dd-292e-405e-8123-11845a695899 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:46.341258 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-6c0b08dd-292e-405e-8123-11845a695899 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:46.350546 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6c0b08dd-292e-405e-8123-11845a695899 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:46.350546 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6c0b08dd-292e-405e-8123-11845a695899 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:46.350546 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6c0b08dd-292e-405e-8123-11845a695899 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:46.350546 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6c0b08dd-292e-405e-8123-11845a695899 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:46.505063 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-6c0b08dd-292e-405e-8123-11845a695899 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:46.512716 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-6c0b08dd-292e-405e-8123-11845a695899 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1575 microversion: 2.1 time: 0.176399 Dec 23 12:10:46.513287 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 556/1148] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:46 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:47.530658 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-54ecd1a6-452d-40e5-8b9e-a40f8938f8b5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:47.531476 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-54ecd1a6-452d-40e5-8b9e-a40f8938f8b5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:47.540676 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-54ecd1a6-452d-40e5-8b9e-a40f8938f8b5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:47.541060 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-54ecd1a6-452d-40e5-8b9e-a40f8938f8b5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:47.542118 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-54ecd1a6-452d-40e5-8b9e-a40f8938f8b5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:47.542775 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-54ecd1a6-452d-40e5-8b9e-a40f8938f8b5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:47.680346 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-54ecd1a6-452d-40e5-8b9e-a40f8938f8b5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:47.688701 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-54ecd1a6-452d-40e5-8b9e-a40f8938f8b5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1575 microversion: 2.1 time: 0.163029 Dec 23 12:10:47.689269 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 593/1149] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:47 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:48.710614 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4abb398e-6d6e-45cc-b96e-37dbe4f1e248 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:48.711462 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4abb398e-6d6e-45cc-b96e-37dbe4f1e248 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:48.722381 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4abb398e-6d6e-45cc-b96e-37dbe4f1e248 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:48.723208 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4abb398e-6d6e-45cc-b96e-37dbe4f1e248 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:48.724509 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4abb398e-6d6e-45cc-b96e-37dbe4f1e248 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:48.725286 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4abb398e-6d6e-45cc-b96e-37dbe4f1e248 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:48.862267 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4abb398e-6d6e-45cc-b96e-37dbe4f1e248 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:48.869750 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4abb398e-6d6e-45cc-b96e-37dbe4f1e248 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1575 microversion: 2.1 time: 0.165577 Dec 23 12:10:48.870429 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 557/1150] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:48 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:49.898391 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-9c22e6a6-db6a-4717-9737-13807afb4212 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:49.899419 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-9c22e6a6-db6a-4717-9737-13807afb4212 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:49.907096 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9c22e6a6-db6a-4717-9737-13807afb4212 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:49.907542 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9c22e6a6-db6a-4717-9737-13807afb4212 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:49.908302 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9c22e6a6-db6a-4717-9737-13807afb4212 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:49.908731 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-9c22e6a6-db6a-4717-9737-13807afb4212 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:50.062227 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-9c22e6a6-db6a-4717-9737-13807afb4212 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:50.071132 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-9c22e6a6-db6a-4717-9737-13807afb4212 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1575 microversion: 2.1 time: 0.178871 Dec 23 12:10:50.071699 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 594/1151] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:49 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:51.087480 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-b633479b-1f39-4049-8f40-7011adeffc38 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:51.088052 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-b633479b-1f39-4049-8f40-7011adeffc38 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:51.094953 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b633479b-1f39-4049-8f40-7011adeffc38 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:51.095409 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b633479b-1f39-4049-8f40-7011adeffc38 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:51.096206 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b633479b-1f39-4049-8f40-7011adeffc38 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:51.096647 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-b633479b-1f39-4049-8f40-7011adeffc38 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:51.318697 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-b633479b-1f39-4049-8f40-7011adeffc38 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:51.326485 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-b633479b-1f39-4049-8f40-7011adeffc38 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1575 microversion: 2.1 time: 0.242679 Dec 23 12:10:51.327079 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 558/1152] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:51 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1575 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:51.700883 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-b2a09e27-b1e8-4b7c-bcc5-886bd745d08d req-06170a20-28c4-4d51-ad87-5e80f5022a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4296b94b-dffe-4ec6-a620-36342be7c07a", "name": "network-vif-deleted", "tag": "3730459e-f7f2-425c-9323-620c407cd290"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:10:51.702601 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:10:51.702601 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:10:51.711936 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-b2a09e27-b1e8-4b7c-bcc5-886bd745d08d req-06170a20-28c4-4d51-ad87-5e80f5022a03 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:51.712474 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-b2a09e27-b1e8-4b7c-bcc5-886bd745d08d req-06170a20-28c4-4d51-ad87-5e80f5022a03 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:51.723860 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-b2a09e27-b1e8-4b7c-bcc5-886bd745d08d req-06170a20-28c4-4d51-ad87-5e80f5022a03 service nova] Creating event network-vif-deleted:3730459e-f7f2-425c-9323-620c407cd290 for instance 4296b94b-dffe-4ec6-a620-36342be7c07a on hv-cinder-82282 Dec 23 12:10:51.729144 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-b2a09e27-b1e8-4b7c-bcc5-886bd745d08d req-06170a20-28c4-4d51-ad87-5e80f5022a03 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032182 Dec 23 12:10:51.730355 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 595/1153] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:10:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:10:52.344138 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-1a617ac2-53cc-4cbe-bb71-5976b27a7e95 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:52.344913 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-1a617ac2-53cc-4cbe-bb71-5976b27a7e95 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:52.352741 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1a617ac2-53cc-4cbe-bb71-5976b27a7e95 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:52.353208 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1a617ac2-53cc-4cbe-bb71-5976b27a7e95 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:52.354012 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1a617ac2-53cc-4cbe-bb71-5976b27a7e95 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:52.354503 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1a617ac2-53cc-4cbe-bb71-5976b27a7e95 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:52.391095 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1a617ac2-53cc-4cbe-bb71-5976b27a7e95 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:52.391548 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-1a617ac2-53cc-4cbe-bb71-5976b27a7e95 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:52.391999 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.objects.instance [None req-1a617ac2-53cc-4cbe-bb71-5976b27a7e95 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lazy-loading 'fault' on Instance uuid 4296b94b-dffe-4ec6-a620-36342be7c07a {{(pid=116355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:10:52.431948 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-1a617ac2-53cc-4cbe-bb71-5976b27a7e95 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:52.439534 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-1a617ac2-53cc-4cbe-bb71-5976b27a7e95 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1230 microversion: 2.1 time: 0.099776 Dec 23 12:10:52.440079 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 559/1154] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:52 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:53.462502 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-731d49d3-eb12-487f-8b72-7aa0cdfa1ab5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:53.463666 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-731d49d3-eb12-487f-8b72-7aa0cdfa1ab5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:53.470652 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-731d49d3-eb12-487f-8b72-7aa0cdfa1ab5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:53.471114 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-731d49d3-eb12-487f-8b72-7aa0cdfa1ab5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:53.471878 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-731d49d3-eb12-487f-8b72-7aa0cdfa1ab5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:53.472309 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-731d49d3-eb12-487f-8b72-7aa0cdfa1ab5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:53.503064 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-731d49d3-eb12-487f-8b72-7aa0cdfa1ab5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:53.503514 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-731d49d3-eb12-487f-8b72-7aa0cdfa1ab5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:53.503964 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-731d49d3-eb12-487f-8b72-7aa0cdfa1ab5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lazy-loading 'fault' on Instance uuid 4296b94b-dffe-4ec6-a620-36342be7c07a {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:10:53.543894 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-731d49d3-eb12-487f-8b72-7aa0cdfa1ab5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:53.551719 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-731d49d3-eb12-487f-8b72-7aa0cdfa1ab5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1230 microversion: 2.1 time: 0.097155 Dec 23 12:10:53.552290 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 596/1155] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:53 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:54.572641 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-9ca5f925-2a73-4088-a964-1a5edd5196f6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:54.574000 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-9ca5f925-2a73-4088-a964-1a5edd5196f6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:54.580422 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9ca5f925-2a73-4088-a964-1a5edd5196f6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:54.580910 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9ca5f925-2a73-4088-a964-1a5edd5196f6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:54.581681 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9ca5f925-2a73-4088-a964-1a5edd5196f6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:54.582115 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9ca5f925-2a73-4088-a964-1a5edd5196f6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:54.614034 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9ca5f925-2a73-4088-a964-1a5edd5196f6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:54.614407 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9ca5f925-2a73-4088-a964-1a5edd5196f6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:54.614893 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.objects.instance [None req-9ca5f925-2a73-4088-a964-1a5edd5196f6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lazy-loading 'fault' on Instance uuid 4296b94b-dffe-4ec6-a620-36342be7c07a {{(pid=116355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:10:54.653740 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-9ca5f925-2a73-4088-a964-1a5edd5196f6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:54.661756 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-9ca5f925-2a73-4088-a964-1a5edd5196f6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1230 microversion: 2.1 time: 0.095407 Dec 23 12:10:54.662326 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 560/1156] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:54 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:55.684923 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4b2fcbc2-b290-4d2a-9bf6-d866fef3e817 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:55.685571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4b2fcbc2-b290-4d2a-9bf6-d866fef3e817 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:55.692157 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4b2fcbc2-b290-4d2a-9bf6-d866fef3e817 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:55.692618 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4b2fcbc2-b290-4d2a-9bf6-d866fef3e817 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:55.693399 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4b2fcbc2-b290-4d2a-9bf6-d866fef3e817 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:55.693847 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4b2fcbc2-b290-4d2a-9bf6-d866fef3e817 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:55.724616 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4b2fcbc2-b290-4d2a-9bf6-d866fef3e817 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:55.725060 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4b2fcbc2-b290-4d2a-9bf6-d866fef3e817 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:55.725526 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-4b2fcbc2-b290-4d2a-9bf6-d866fef3e817 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lazy-loading 'fault' on Instance uuid 4296b94b-dffe-4ec6-a620-36342be7c07a {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:10:55.765910 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4b2fcbc2-b290-4d2a-9bf6-d866fef3e817 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:55.773787 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4b2fcbc2-b290-4d2a-9bf6-d866fef3e817 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 200 len: 1230 microversion: 2.1 time: 0.095581 Dec 23 12:10:55.774374 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 597/1157] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:55 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:56.794073 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8625d55c-8c6c-44f6-9923-17c6d6124cf5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:56.794708 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-8625d55c-8c6c-44f6-9923-17c6d6124cf5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:56.801659 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8625d55c-8c6c-44f6-9923-17c6d6124cf5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:56.802119 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8625d55c-8c6c-44f6-9923-17c6d6124cf5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:56.802943 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8625d55c-8c6c-44f6-9923-17c6d6124cf5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:56.803383 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8625d55c-8c6c-44f6-9923-17c6d6124cf5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:56.817408 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-8625d55c-8c6c-44f6-9923-17c6d6124cf5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] HTTP exception thrown: Instance 4296b94b-dffe-4ec6-a620-36342be7c07a could not be found. Dec 23 12:10:56.818011 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8625d55c-8c6c-44f6-9923-17c6d6124cf5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Returning 404 to user: Instance 4296b94b-dffe-4ec6-a620-36342be7c07a could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:10:56.818863 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-8625d55c-8c6c-44f6-9923-17c6d6124cf5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 404 len: 111 microversion: 2.1 time: 0.030343 Dec 23 12:10:56.819415 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 561/1158] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:56 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:10:56.929014 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-14cc8f31-4192-445a-88ca-b68c37bbcc86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1043958712", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2138957045", "security_groups": [{"name": "tempest-secgroup-smoke-1922405993"}], "block_device_mapping_v2": [{"uuid": "d7b22d35-4596-4950-8398-cc5c8e8f4221", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cb185919-e3e9-4255-a3cb-29bc627cf289"}]}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:10:57.047205 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.network.neutron [None req-14cc8f31-4192-445a-88ca-b68c37bbcc86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] validate_networks() for [('cb185919-e3e9-4255-a3cb-29bc627cf289', None, None, None, None, None)] {{(pid=116354) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 12:10:57.427754 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-14cc8f31-4192-445a-88ca-b68c37bbcc86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Flavor limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 12:10:57.428191 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-14cc8f31-4192-445a-88ca-b68c37bbcc86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Image limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 12:10:57.428664 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-14cc8f31-4192-445a-88ca-b68c37bbcc86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Flavor pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 12:10:57.429116 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-14cc8f31-4192-445a-88ca-b68c37bbcc86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Image pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 12:10:57.429590 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-14cc8f31-4192-445a-88ca-b68c37bbcc86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 12:10:57.439483 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-14cc8f31-4192-445a-88ca-b68c37bbcc86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:57.439937 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-14cc8f31-4192-445a-88ca-b68c37bbcc86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:57.440766 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-14cc8f31-4192-445a-88ca-b68c37bbcc86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:57.441262 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-14cc8f31-4192-445a-88ca-b68c37bbcc86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:57.458325 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-14cc8f31-4192-445a-88ca-b68c37bbcc86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Getting quotas for project 65754771daec4e08922a4c10f20ca653. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:10:57.463210 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-14cc8f31-4192-445a-88ca-b68c37bbcc86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Getting quotas for user 28fb997ba3e94ce4a7cff5d5efe7d4b2 and project 65754771daec4e08922a4c10f20ca653. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:10:57.520159 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-14cc8f31-4192-445a-88ca-b68c37bbcc86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Going to run 1 instances... {{(pid=116354) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 12:10:57.522306 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-14cc8f31-4192-445a-88ca-b68c37bbcc86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d7b22d35-4596-4950-8398-cc5c8e8f4221',volume_size=None,volume_type=None)] {{(pid=116354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 12:10:57.679479 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-14cc8f31-4192-445a-88ca-b68c37bbcc86 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.754022 Dec 23 12:10:57.680130 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 598/1159] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 12:10:56 2021] POST /compute/v2.1/servers => generated 406 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 12:10:57.689862 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-803cec5e-4372-400f-8732-a1bffe421112 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:57.690473 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-803cec5e-4372-400f-8732-a1bffe421112 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:57.747898 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-803cec5e-4372-400f-8732-a1bffe421112 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:57.754816 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-803cec5e-4372-400f-8732-a1bffe421112 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1095 microversion: 2.1 time: 0.068550 Dec 23 12:10:57.755355 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 562/1160] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:57 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:58.771595 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-3bd0ae10-0599-482b-a57e-56a5b5b90837 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:58.772225 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-3bd0ae10-0599-482b-a57e-56a5b5b90837 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:58.778880 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3bd0ae10-0599-482b-a57e-56a5b5b90837 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:58.779344 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3bd0ae10-0599-482b-a57e-56a5b5b90837 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:58.780248 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3bd0ae10-0599-482b-a57e-56a5b5b90837 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:58.780690 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-3bd0ae10-0599-482b-a57e-56a5b5b90837 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:58.840495 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-3bd0ae10-0599-482b-a57e-56a5b5b90837 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:10:58.848771 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-3bd0ae10-0599-482b-a57e-56a5b5b90837 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1201 microversion: 2.1 time: 0.080795 Dec 23 12:10:58.849560 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 599/1161] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:58 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1201 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:10:59.866119 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4dd37405-7572-4a5e-8268-347627f760e5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:10:59.866863 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4dd37405-7572-4a5e-8268-347627f760e5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:10:59.874797 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4dd37405-7572-4a5e-8268-347627f760e5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:59.875334 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4dd37405-7572-4a5e-8268-347627f760e5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:10:59.876204 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4dd37405-7572-4a5e-8268-347627f760e5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:10:59.876716 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4dd37405-7572-4a5e-8268-347627f760e5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:00.073082 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4dd37405-7572-4a5e-8268-347627f760e5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:11:00.080615 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4dd37405-7572-4a5e-8268-347627f760e5 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1267 microversion: 2.1 time: 0.218156 Dec 23 12:11:00.081187 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 563/1162] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:10:59 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:11:00.337015 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-d5e3ec37-3811-4cc2-b120-79f19df06fcf req-f22fadd1-3989-4eb8-8b04-cd20b04c28ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9cea23a-0a02-42c5-bc21-4fb61f979c10", "tag": "92f81f7f-88ea-428a-96d4-9eee250bbe11"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:11:00.338628 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:11:00.338628 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:11:00.356341 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-d5e3ec37-3811-4cc2-b120-79f19df06fcf req-f22fadd1-3989-4eb8-8b04-cd20b04c28ac service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:00.357484 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-d5e3ec37-3811-4cc2-b120-79f19df06fcf req-f22fadd1-3989-4eb8-8b04-cd20b04c28ac service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:00.371605 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-d5e3ec37-3811-4cc2-b120-79f19df06fcf req-f22fadd1-3989-4eb8-8b04-cd20b04c28ac service nova] Creating event network-changed:92f81f7f-88ea-428a-96d4-9eee250bbe11 for instance c9cea23a-0a02-42c5-bc21-4fb61f979c10 on hv-cinder-82282 Dec 23 12:11:00.377598 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-d5e3ec37-3811-4cc2-b120-79f19df06fcf req-f22fadd1-3989-4eb8-8b04-cd20b04c28ac service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044715 Dec 23 12:11:00.378252 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 600/1163] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:11:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 12:11:01.096853 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8e23074f-e17a-476d-aeba-51ecbb5d3f64 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:11:01.097481 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-8e23074f-e17a-476d-aeba-51ecbb5d3f64 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:11:01.103649 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8e23074f-e17a-476d-aeba-51ecbb5d3f64 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:01.104117 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8e23074f-e17a-476d-aeba-51ecbb5d3f64 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:01.105353 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8e23074f-e17a-476d-aeba-51ecbb5d3f64 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:01.105802 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8e23074f-e17a-476d-aeba-51ecbb5d3f64 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:01.270704 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-8e23074f-e17a-476d-aeba-51ecbb5d3f64 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:11:01.279257 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-8e23074f-e17a-476d-aeba-51ecbb5d3f64 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1267 microversion: 2.1 time: 0.185942 Dec 23 12:11:01.279862 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 564/1164] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:11:01 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:11:02.296901 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-78a9cfa7-9537-4e3f-929d-e3cbd89be43d tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:11:02.297603 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-78a9cfa7-9537-4e3f-929d-e3cbd89be43d tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:11:02.303793 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-78a9cfa7-9537-4e3f-929d-e3cbd89be43d tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:02.304220 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-78a9cfa7-9537-4e3f-929d-e3cbd89be43d tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:02.305011 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-78a9cfa7-9537-4e3f-929d-e3cbd89be43d tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:02.305424 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-78a9cfa7-9537-4e3f-929d-e3cbd89be43d tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:02.444059 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-78a9cfa7-9537-4e3f-929d-e3cbd89be43d tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:11:02.451451 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-78a9cfa7-9537-4e3f-929d-e3cbd89be43d tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1267 microversion: 2.1 time: 0.159189 Dec 23 12:11:02.452261 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 601/1165] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:11:02 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:11:03.469287 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-7f7ccdef-ceeb-45e9-b0bc-486ba86570e0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:11:03.469929 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-7f7ccdef-ceeb-45e9-b0bc-486ba86570e0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:11:03.476615 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7f7ccdef-ceeb-45e9-b0bc-486ba86570e0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:03.477084 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7f7ccdef-ceeb-45e9-b0bc-486ba86570e0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:03.477875 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7f7ccdef-ceeb-45e9-b0bc-486ba86570e0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:03.478313 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7f7ccdef-ceeb-45e9-b0bc-486ba86570e0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:03.619820 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-7f7ccdef-ceeb-45e9-b0bc-486ba86570e0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:11:03.630731 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-7f7ccdef-ceeb-45e9-b0bc-486ba86570e0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1267 microversion: 2.1 time: 0.165065 Dec 23 12:11:03.631302 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 565/1166] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:11:03 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:11:04.649283 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-56d9785d-4732-4a9b-b559-1a427b6eceb3 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:11:04.650069 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-56d9785d-4732-4a9b-b559-1a427b6eceb3 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:11:04.658187 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-56d9785d-4732-4a9b-b559-1a427b6eceb3 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:04.658666 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-56d9785d-4732-4a9b-b559-1a427b6eceb3 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:04.659457 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-56d9785d-4732-4a9b-b559-1a427b6eceb3 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:04.659888 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-56d9785d-4732-4a9b-b559-1a427b6eceb3 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:04.803789 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-56d9785d-4732-4a9b-b559-1a427b6eceb3 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:11:04.813244 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-56d9785d-4732-4a9b-b559-1a427b6eceb3 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1267 microversion: 2.1 time: 0.168349 Dec 23 12:11:04.814376 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 602/1167] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:11:04 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:11:05.834473 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-445e535a-e239-4f60-bbfc-a260446caed7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:11:05.835532 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-445e535a-e239-4f60-bbfc-a260446caed7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:11:05.847448 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-445e535a-e239-4f60-bbfc-a260446caed7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:05.847448 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-445e535a-e239-4f60-bbfc-a260446caed7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:05.848703 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-445e535a-e239-4f60-bbfc-a260446caed7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:05.849442 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-445e535a-e239-4f60-bbfc-a260446caed7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:06.009316 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-445e535a-e239-4f60-bbfc-a260446caed7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:11:06.029095 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-445e535a-e239-4f60-bbfc-a260446caed7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1267 microversion: 2.1 time: 0.200739 Dec 23 12:11:06.038205 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 566/1168] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:11:05 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:11:07.046992 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8acebe86-9419-4097-8d80-b0441a387d37 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:11:07.047725 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8acebe86-9419-4097-8d80-b0441a387d37 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:11:07.055085 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8acebe86-9419-4097-8d80-b0441a387d37 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:07.055609 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8acebe86-9419-4097-8d80-b0441a387d37 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:07.056516 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8acebe86-9419-4097-8d80-b0441a387d37 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:07.057028 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8acebe86-9419-4097-8d80-b0441a387d37 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:07.191779 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8acebe86-9419-4097-8d80-b0441a387d37 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:11:07.200353 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8acebe86-9419-4097-8d80-b0441a387d37 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1267 microversion: 2.1 time: 0.157669 Dec 23 12:11:07.201128 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 603/1169] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:11:07 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:11:08.223001 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-013d5b76-92d3-4ad7-b7d4-b7e1afc836a4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:11:08.223947 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-013d5b76-92d3-4ad7-b7d4-b7e1afc836a4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:11:08.234372 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-013d5b76-92d3-4ad7-b7d4-b7e1afc836a4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:08.234854 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-013d5b76-92d3-4ad7-b7d4-b7e1afc836a4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:08.235637 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-013d5b76-92d3-4ad7-b7d4-b7e1afc836a4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:08.236074 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-013d5b76-92d3-4ad7-b7d4-b7e1afc836a4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:08.375392 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-013d5b76-92d3-4ad7-b7d4-b7e1afc836a4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:11:08.383101 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-013d5b76-92d3-4ad7-b7d4-b7e1afc836a4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1267 microversion: 2.1 time: 0.167074 Dec 23 12:11:08.383689 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 567/1170] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:11:08 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:11:09.403669 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-03b87723-5922-48ee-8a68-8da9b02a7791 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:11:09.404317 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-03b87723-5922-48ee-8a68-8da9b02a7791 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:11:09.413937 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-03b87723-5922-48ee-8a68-8da9b02a7791 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:09.414806 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-03b87723-5922-48ee-8a68-8da9b02a7791 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:09.416195 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-03b87723-5922-48ee-8a68-8da9b02a7791 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:09.417480 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-03b87723-5922-48ee-8a68-8da9b02a7791 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:09.501153 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 23 12:11:09.501765 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: Thu Dec 23 12:11:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 23 12:11:09.566373 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-03b87723-5922-48ee-8a68-8da9b02a7791 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:11:09.577526 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-03b87723-5922-48ee-8a68-8da9b02a7791 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1267 microversion: 2.1 time: 0.177307 Dec 23 12:11:09.578030 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 604/1171] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:11:09 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:11:10.593657 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a77697aa-b385-4f82-bf7e-cacc19cf8ae6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:11:10.594244 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a77697aa-b385-4f82-bf7e-cacc19cf8ae6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:11:10.601518 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a77697aa-b385-4f82-bf7e-cacc19cf8ae6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:10.601971 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a77697aa-b385-4f82-bf7e-cacc19cf8ae6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:10.602788 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a77697aa-b385-4f82-bf7e-cacc19cf8ae6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:10.603219 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a77697aa-b385-4f82-bf7e-cacc19cf8ae6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:10.748616 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-a77697aa-b385-4f82-bf7e-cacc19cf8ae6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:11:10.760207 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a77697aa-b385-4f82-bf7e-cacc19cf8ae6 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1267 microversion: 2.1 time: 0.170252 Dec 23 12:11:10.760780 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 568/1172] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:11:10 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:11:11.776036 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ef31e746-9862-40b4-83f2-f4d01b8d93c2 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:11:11.776733 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ef31e746-9862-40b4-83f2-f4d01b8d93c2 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:11:11.783020 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ef31e746-9862-40b4-83f2-f4d01b8d93c2 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:11.783540 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ef31e746-9862-40b4-83f2-f4d01b8d93c2 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:11.784411 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ef31e746-9862-40b4-83f2-f4d01b8d93c2 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:11.784978 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ef31e746-9862-40b4-83f2-f4d01b8d93c2 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:11.946494 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ef31e746-9862-40b4-83f2-f4d01b8d93c2 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:11:11.955165 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ef31e746-9862-40b4-83f2-f4d01b8d93c2 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1267 microversion: 2.1 time: 0.182765 Dec 23 12:11:11.956495 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 605/1173] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:11:11 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:11:12.103528 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-5fd1ea4a-4248-4d39-a9af-fdfd87dada53 req-229f746d-b3e1-4ee0-b1ed-05195b98246b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cea23a-0a02-42c5-bc21-4fb61f979c10", "name": "network-vif-plugged", "status": "completed", "tag": "92f81f7f-88ea-428a-96d4-9eee250bbe11"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:11:12.110448 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:11:12.110448 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:11:12.122754 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-5fd1ea4a-4248-4d39-a9af-fdfd87dada53 req-229f746d-b3e1-4ee0-b1ed-05195b98246b service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:12.123375 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-5fd1ea4a-4248-4d39-a9af-fdfd87dada53 req-229f746d-b3e1-4ee0-b1ed-05195b98246b service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:12.135907 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-5fd1ea4a-4248-4d39-a9af-fdfd87dada53 req-229f746d-b3e1-4ee0-b1ed-05195b98246b service nova] Creating event network-vif-plugged:92f81f7f-88ea-428a-96d4-9eee250bbe11 for instance c9cea23a-0a02-42c5-bc21-4fb61f979c10 on hv-cinder-82282 Dec 23 12:11:12.141565 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-5fd1ea4a-4248-4d39-a9af-fdfd87dada53 req-229f746d-b3e1-4ee0-b1ed-05195b98246b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043092 Dec 23 12:11:12.142536 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 569/1174] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:11:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:11:12.972527 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b9ec2f91-e64a-471f-8140-e278b862a0f7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:11:12.973146 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b9ec2f91-e64a-471f-8140-e278b862a0f7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:11:12.979613 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b9ec2f91-e64a-471f-8140-e278b862a0f7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:12.980183 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b9ec2f91-e64a-471f-8140-e278b862a0f7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:12.980998 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b9ec2f91-e64a-471f-8140-e278b862a0f7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:12.981443 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b9ec2f91-e64a-471f-8140-e278b862a0f7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:13.117365 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-b9ec2f91-e64a-471f-8140-e278b862a0f7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:11:13.124971 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b9ec2f91-e64a-471f-8140-e278b862a0f7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1267 microversion: 2.1 time: 0.156074 Dec 23 12:11:13.125645 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 606/1175] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:11:12 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:11:14.142389 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-cddb944d-1025-4cd4-a8e5-de17723bb275 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:11:14.143230 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-cddb944d-1025-4cd4-a8e5-de17723bb275 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:11:14.149558 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cddb944d-1025-4cd4-a8e5-de17723bb275 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:14.149983 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cddb944d-1025-4cd4-a8e5-de17723bb275 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:14.150808 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cddb944d-1025-4cd4-a8e5-de17723bb275 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:14.151223 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cddb944d-1025-4cd4-a8e5-de17723bb275 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:14.293890 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-cddb944d-1025-4cd4-a8e5-de17723bb275 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:11:14.301542 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-cddb944d-1025-4cd4-a8e5-de17723bb275 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1454 microversion: 2.1 time: 0.163924 Dec 23 12:11:14.302124 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 570/1176] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:11:14 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:11:14.318870 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2eab1b19-f01f-4558-a211-124c00a85cf7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:11:14.319697 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2eab1b19-f01f-4558-a211-124c00a85cf7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:11:14.326475 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2eab1b19-f01f-4558-a211-124c00a85cf7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:14.327205 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2eab1b19-f01f-4558-a211-124c00a85cf7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:14.327861 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2eab1b19-f01f-4558-a211-124c00a85cf7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:14.328424 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2eab1b19-f01f-4558-a211-124c00a85cf7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:14.463292 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2eab1b19-f01f-4558-a211-124c00a85cf7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:11:14.471235 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2eab1b19-f01f-4558-a211-124c00a85cf7 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1454 microversion: 2.1 time: 0.156281 Dec 23 12:11:14.471827 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 607/1177] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:11:14 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:11:16.316547 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-24506dc9-ed92-4474-991b-004fa0dc4e49 req-5654df90-eaf1-4549-a1e1-74877b15002e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9cea23a-0a02-42c5-bc21-4fb61f979c10", "tag": "92f81f7f-88ea-428a-96d4-9eee250bbe11"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:11:16.319026 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:11:16.319026 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:11:16.327093 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-24506dc9-ed92-4474-991b-004fa0dc4e49 req-5654df90-eaf1-4549-a1e1-74877b15002e service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:11:16.327671 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-24506dc9-ed92-4474-991b-004fa0dc4e49 req-5654df90-eaf1-4549-a1e1-74877b15002e service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:11:16.339218 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-24506dc9-ed92-4474-991b-004fa0dc4e49 req-5654df90-eaf1-4549-a1e1-74877b15002e service nova] Creating event network-changed:92f81f7f-88ea-428a-96d4-9eee250bbe11 for instance c9cea23a-0a02-42c5-bc21-4fb61f979c10 on hv-cinder-82282 Dec 23 12:11:16.344450 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-24506dc9-ed92-4474-991b-004fa0dc4e49 req-5654df90-eaf1-4549-a1e1-74877b15002e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031843 Dec 23 12:11:16.345394 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 571/1178] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:11:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:12:05.254908 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 23 12:12:05.255628 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: Thu Dec 23 12:12:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 23 12:12:28.491881 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-f0aabc43-c77f-4f01-b36e-505651c76831 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Action: 'create', calling method: .version_select at 0x7fcf2860ca60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1771458219"}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:12:28.506739 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-f0aabc43-c77f-4f01-b36e-505651c76831 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Getting quotas for project 261f3dd2fce84f6ba9012d9b2b7b8820. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:12:28.510993 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-f0aabc43-c77f-4f01-b36e-505651c76831 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Getting quotas for user 12e2a6e84ef54db284199ad0d460ca49 and project 261f3dd2fce84f6ba9012d9b2b7b8820. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:12:28.687030 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-f0aabc43-c77f-4f01-b36e-505651c76831 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Getting quotas for project 261f3dd2fce84f6ba9012d9b2b7b8820. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:12:28.690775 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-f0aabc43-c77f-4f01-b36e-505651c76831 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Getting quotas for user 12e2a6e84ef54db284199ad0d460ca49 and project 261f3dd2fce84f6ba9012d9b2b7b8820. Resources: {'key_pairs'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:12:28.704012 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-f0aabc43-c77f-4f01-b36e-505651c76831 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.218327 Dec 23 12:12:28.704600 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 608/1179] 10.222.0.65 () {60 vars in 1157 bytes} [Thu Dec 23 12:12:28 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:28.761265 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-6786ffb6-57ff-4560-9e7f-89dede482242 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-258984340", "imageRef": "f3800d73-a358-41bb-8844-479a975cab02", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1771458219", "networks": [{"uuid": "93a34628-ca73-4073-8e65-978439af824b"}]}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:12:28.823994 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.network.neutron [None req-6786ffb6-57ff-4560-9e7f-89dede482242 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] validate_networks() for [('93a34628-ca73-4073-8e65-978439af824b', None, None, None, None, None)] {{(pid=116355) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 12:12:29.337399 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-6786ffb6-57ff-4560-9e7f-89dede482242 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Flavor limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 12:12:29.337800 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-6786ffb6-57ff-4560-9e7f-89dede482242 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Image limits 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 12:12:29.338276 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-6786ffb6-57ff-4560-9e7f-89dede482242 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Flavor pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 12:12:29.338750 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-6786ffb6-57ff-4560-9e7f-89dede482242 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Image pref 0:0:0 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 12:12:29.339137 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.virt.hardware [None req-6786ffb6-57ff-4560-9e7f-89dede482242 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 12:12:29.349408 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6786ffb6-57ff-4560-9e7f-89dede482242 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:29.349855 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6786ffb6-57ff-4560-9e7f-89dede482242 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:29.350719 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6786ffb6-57ff-4560-9e7f-89dede482242 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:29.351158 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6786ffb6-57ff-4560-9e7f-89dede482242 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:29.368176 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-6786ffb6-57ff-4560-9e7f-89dede482242 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Getting quotas for project 261f3dd2fce84f6ba9012d9b2b7b8820. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:12:29.372236 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.quota [None req-6786ffb6-57ff-4560-9e7f-89dede482242 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Getting quotas for user 12e2a6e84ef54db284199ad0d460ca49 and project 261f3dd2fce84f6ba9012d9b2b7b8820. Resources: {'cores', 'ram', 'instances'} {{(pid=116355) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:12:29.383247 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-6786ffb6-57ff-4560-9e7f-89dede482242 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Going to run 1 instances... {{(pid=116355) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 12:12:29.385656 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-6786ffb6-57ff-4560-9e7f-89dede482242 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3800d73-a358-41bb-8844-479a975cab02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 12:12:29.435870 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-6786ffb6-57ff-4560-9e7f-89dede482242 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679924 Dec 23 12:12:29.436509 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 572/1180] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 12:12:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 12:12:29.449252 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c4c65d13-4ce8-46cf-b112-c1226f0b07e3 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:29.450108 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c4c65d13-4ce8-46cf-b112-c1226f0b07e3 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:29.508379 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-c4c65d13-4ce8-46cf-b112-c1226f0b07e3 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:29.515896 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c4c65d13-4ce8-46cf-b112-c1226f0b07e3 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1258 microversion: 2.1 time: 0.072625 Dec 23 12:12:29.516502 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 609/1181] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:29 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:30.533392 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-9133c194-81c0-4c8f-ac3c-051f4f2814f5 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:30.534022 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-9133c194-81c0-4c8f-ac3c-051f4f2814f5 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:30.541718 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9133c194-81c0-4c8f-ac3c-051f4f2814f5 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:30.542183 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9133c194-81c0-4c8f-ac3c-051f4f2814f5 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:30.543021 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9133c194-81c0-4c8f-ac3c-051f4f2814f5 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:30.543459 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9133c194-81c0-4c8f-ac3c-051f4f2814f5 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:30.606955 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-9133c194-81c0-4c8f-ac3c-051f4f2814f5 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:30.615239 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-9133c194-81c0-4c8f-ac3c-051f4f2814f5 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1310 microversion: 2.1 time: 0.086052 Dec 23 12:12:30.615799 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 573/1182] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:30 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:31.634304 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-60d21b0e-0f51-4e40-bfa2-8acd5cac15f8 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:31.635115 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-60d21b0e-0f51-4e40-bfa2-8acd5cac15f8 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:31.644501 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-60d21b0e-0f51-4e40-bfa2-8acd5cac15f8 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:31.644957 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-60d21b0e-0f51-4e40-bfa2-8acd5cac15f8 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:31.645763 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-60d21b0e-0f51-4e40-bfa2-8acd5cac15f8 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:31.646197 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-60d21b0e-0f51-4e40-bfa2-8acd5cac15f8 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:31.791425 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-60d21b0e-0f51-4e40-bfa2-8acd5cac15f8 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:31.799478 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-60d21b0e-0f51-4e40-bfa2-8acd5cac15f8 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1358 microversion: 2.1 time: 0.170322 Dec 23 12:12:31.802695 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 610/1183] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:31 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:32.821181 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ae6f7fc8-230f-4e88-932b-3d10dd1b7e7f tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:32.821786 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ae6f7fc8-230f-4e88-932b-3d10dd1b7e7f tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:32.828453 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ae6f7fc8-230f-4e88-932b-3d10dd1b7e7f tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:32.828916 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ae6f7fc8-230f-4e88-932b-3d10dd1b7e7f tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:32.829701 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ae6f7fc8-230f-4e88-932b-3d10dd1b7e7f tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:32.830184 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ae6f7fc8-230f-4e88-932b-3d10dd1b7e7f tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:32.971716 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ae6f7fc8-230f-4e88-932b-3d10dd1b7e7f tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:32.980431 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ae6f7fc8-230f-4e88-932b-3d10dd1b7e7f tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1358 microversion: 2.1 time: 0.165046 Dec 23 12:12:32.981230 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 574/1184] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:32 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:33.997608 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4053edea-1b6f-4cb2-acdf-c63a369c2c94 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:33.998178 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4053edea-1b6f-4cb2-acdf-c63a369c2c94 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:34.004747 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4053edea-1b6f-4cb2-acdf-c63a369c2c94 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:34.005198 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4053edea-1b6f-4cb2-acdf-c63a369c2c94 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:34.005984 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4053edea-1b6f-4cb2-acdf-c63a369c2c94 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:34.006413 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4053edea-1b6f-4cb2-acdf-c63a369c2c94 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:34.146238 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4053edea-1b6f-4cb2-acdf-c63a369c2c94 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:34.154782 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4053edea-1b6f-4cb2-acdf-c63a369c2c94 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1358 microversion: 2.1 time: 0.161198 Dec 23 12:12:34.155369 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 611/1185] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:33 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:35.171801 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c5b2a445-128e-4637-8733-9308b67a6ca0 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:35.172431 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c5b2a445-128e-4637-8733-9308b67a6ca0 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:35.182250 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c5b2a445-128e-4637-8733-9308b67a6ca0 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:35.182736 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c5b2a445-128e-4637-8733-9308b67a6ca0 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:35.183529 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c5b2a445-128e-4637-8733-9308b67a6ca0 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:35.183969 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c5b2a445-128e-4637-8733-9308b67a6ca0 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:35.325427 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c5b2a445-128e-4637-8733-9308b67a6ca0 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:35.334544 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c5b2a445-128e-4637-8733-9308b67a6ca0 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1358 microversion: 2.1 time: 0.166553 Dec 23 12:12:35.335590 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 575/1186] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:35 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:36.352119 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-16c97549-3e96-41fe-939d-cfae0f531eb8 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:36.353973 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-16c97549-3e96-41fe-939d-cfae0f531eb8 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:36.363230 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-16c97549-3e96-41fe-939d-cfae0f531eb8 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:36.364247 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-16c97549-3e96-41fe-939d-cfae0f531eb8 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:36.365106 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-16c97549-3e96-41fe-939d-cfae0f531eb8 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:36.365640 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-16c97549-3e96-41fe-939d-cfae0f531eb8 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:36.504288 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-16c97549-3e96-41fe-939d-cfae0f531eb8 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:36.512463 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-16c97549-3e96-41fe-939d-cfae0f531eb8 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1358 microversion: 2.1 time: 0.164091 Dec 23 12:12:36.513052 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 612/1187] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:36 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:37.529490 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-84e958ef-510e-499e-8693-e2636f2b7bdd tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:37.530130 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-84e958ef-510e-499e-8693-e2636f2b7bdd tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:37.539792 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-84e958ef-510e-499e-8693-e2636f2b7bdd tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:37.540408 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-84e958ef-510e-499e-8693-e2636f2b7bdd tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:37.541651 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-84e958ef-510e-499e-8693-e2636f2b7bdd tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:37.542196 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-84e958ef-510e-499e-8693-e2636f2b7bdd tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:37.676487 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-84e958ef-510e-499e-8693-e2636f2b7bdd tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:37.684322 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-84e958ef-510e-499e-8693-e2636f2b7bdd tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1358 microversion: 2.1 time: 0.158611 Dec 23 12:12:37.684883 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 576/1188] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:37 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:38.701326 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-46e6d384-748c-4788-bf8d-0741a51c5207 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:38.701936 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-46e6d384-748c-4788-bf8d-0741a51c5207 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:38.708480 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-46e6d384-748c-4788-bf8d-0741a51c5207 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:38.709202 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-46e6d384-748c-4788-bf8d-0741a51c5207 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:38.709990 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-46e6d384-748c-4788-bf8d-0741a51c5207 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:38.710435 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-46e6d384-748c-4788-bf8d-0741a51c5207 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:38.847819 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-46e6d384-748c-4788-bf8d-0741a51c5207 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:38.855565 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-46e6d384-748c-4788-bf8d-0741a51c5207 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1358 microversion: 2.1 time: 0.158090 Dec 23 12:12:38.856142 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 613/1189] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:38 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:39.872800 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-c627b240-0771-4e0b-9261-028b76590cb3 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:39.873412 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-c627b240-0771-4e0b-9261-028b76590cb3 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:39.879987 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c627b240-0771-4e0b-9261-028b76590cb3 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:39.880436 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c627b240-0771-4e0b-9261-028b76590cb3 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:39.881231 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c627b240-0771-4e0b-9261-028b76590cb3 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:39.881674 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-c627b240-0771-4e0b-9261-028b76590cb3 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:40.012882 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-c627b240-0771-4e0b-9261-028b76590cb3 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:40.020856 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-c627b240-0771-4e0b-9261-028b76590cb3 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1358 microversion: 2.1 time: 0.151704 Dec 23 12:12:40.021660 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 577/1190] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:39 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:12:41.039428 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e41ac3cb-3937-4bbb-9bc1-d4deee983604 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:41.040348 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e41ac3cb-3937-4bbb-9bc1-d4deee983604 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:41.048442 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e41ac3cb-3937-4bbb-9bc1-d4deee983604 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:41.048898 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e41ac3cb-3937-4bbb-9bc1-d4deee983604 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:41.049688 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e41ac3cb-3937-4bbb-9bc1-d4deee983604 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:41.050160 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e41ac3cb-3937-4bbb-9bc1-d4deee983604 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:41.181851 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e41ac3cb-3937-4bbb-9bc1-d4deee983604 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:41.189648 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e41ac3cb-3937-4bbb-9bc1-d4deee983604 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1358 microversion: 2.1 time: 0.154351 Dec 23 12:12:41.190422 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 614/1191] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:41 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:42.207242 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-01eb6902-71ff-4b16-a16c-72cf8f796dd4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:42.208007 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-01eb6902-71ff-4b16-a16c-72cf8f796dd4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:42.213920 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-01eb6902-71ff-4b16-a16c-72cf8f796dd4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:42.214372 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-01eb6902-71ff-4b16-a16c-72cf8f796dd4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:42.215196 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-01eb6902-71ff-4b16-a16c-72cf8f796dd4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:42.215635 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-01eb6902-71ff-4b16-a16c-72cf8f796dd4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:42.436471 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-01eb6902-71ff-4b16-a16c-72cf8f796dd4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:42.444344 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-01eb6902-71ff-4b16-a16c-72cf8f796dd4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1358 microversion: 2.1 time: 0.241221 Dec 23 12:12:42.444912 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 578/1192] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:42 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:42.773592 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-2781d2c7-945b-4a50-8263-e98acb2cf2e8 req-1a68b3f1-9b46-4d81-8f70-6161b73e4ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c088f48b-5f59-4c34-9fcb-5bc13dbee3ed", "tag": "0c5c9304-bccc-488a-8e51-116a85984824"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:12:42.775158 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:12:42.775158 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:12:42.783993 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-2781d2c7-945b-4a50-8263-e98acb2cf2e8 req-1a68b3f1-9b46-4d81-8f70-6161b73e4ef8 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:42.784431 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-2781d2c7-945b-4a50-8263-e98acb2cf2e8 req-1a68b3f1-9b46-4d81-8f70-6161b73e4ef8 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:42.805794 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-2781d2c7-945b-4a50-8263-e98acb2cf2e8 req-1a68b3f1-9b46-4d81-8f70-6161b73e4ef8 service nova] Creating event network-changed:0c5c9304-bccc-488a-8e51-116a85984824 for instance c088f48b-5f59-4c34-9fcb-5bc13dbee3ed on hv-cinder-82282 Dec 23 12:12:42.810863 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-2781d2c7-945b-4a50-8263-e98acb2cf2e8 req-1a68b3f1-9b46-4d81-8f70-6161b73e4ef8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041326 Dec 23 12:12:42.811463 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 615/1193] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:12:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:12:43.462318 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-63702d95-5851-4fd1-b4e7-d7edb0ff7645 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:43.462964 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-63702d95-5851-4fd1-b4e7-d7edb0ff7645 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:43.469663 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-63702d95-5851-4fd1-b4e7-d7edb0ff7645 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:43.470180 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-63702d95-5851-4fd1-b4e7-d7edb0ff7645 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:43.471039 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-63702d95-5851-4fd1-b4e7-d7edb0ff7645 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:43.471477 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-63702d95-5851-4fd1-b4e7-d7edb0ff7645 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:43.677785 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-63702d95-5851-4fd1-b4e7-d7edb0ff7645 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:43.685710 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-63702d95-5851-4fd1-b4e7-d7edb0ff7645 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1358 microversion: 2.1 time: 0.227175 Dec 23 12:12:43.693817 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 579/1194] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:43 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:44.704388 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-ca54c974-43ed-48c0-9bee-05367a69b18f tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:44.704974 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-ca54c974-43ed-48c0-9bee-05367a69b18f tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:44.711684 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ca54c974-43ed-48c0-9bee-05367a69b18f tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:44.712143 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ca54c974-43ed-48c0-9bee-05367a69b18f tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:44.712927 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ca54c974-43ed-48c0-9bee-05367a69b18f tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:44.713367 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-ca54c974-43ed-48c0-9bee-05367a69b18f tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:44.853496 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-ca54c974-43ed-48c0-9bee-05367a69b18f tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:44.865517 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-ca54c974-43ed-48c0-9bee-05367a69b18f tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1358 microversion: 2.1 time: 0.165672 Dec 23 12:12:44.866294 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 616/1195] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:44 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:45.889440 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-61099092-00f0-452c-a6f7-b0fe2543bf84 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:45.890373 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-61099092-00f0-452c-a6f7-b0fe2543bf84 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:45.897788 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-61099092-00f0-452c-a6f7-b0fe2543bf84 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:45.898291 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-61099092-00f0-452c-a6f7-b0fe2543bf84 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:45.899188 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-61099092-00f0-452c-a6f7-b0fe2543bf84 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:45.899680 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-61099092-00f0-452c-a6f7-b0fe2543bf84 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:46.041030 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-61099092-00f0-452c-a6f7-b0fe2543bf84 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:46.049425 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-61099092-00f0-452c-a6f7-b0fe2543bf84 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1358 microversion: 2.1 time: 0.166140 Dec 23 12:12:46.049967 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 580/1196] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:45 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:47.066422 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8444196f-5f11-4961-8494-12d0f1e119fb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:47.067058 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8444196f-5f11-4961-8494-12d0f1e119fb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:47.073454 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8444196f-5f11-4961-8494-12d0f1e119fb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:47.073908 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8444196f-5f11-4961-8494-12d0f1e119fb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:47.074725 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8444196f-5f11-4961-8494-12d0f1e119fb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:47.075207 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8444196f-5f11-4961-8494-12d0f1e119fb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:47.211494 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8444196f-5f11-4961-8494-12d0f1e119fb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:47.221522 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8444196f-5f11-4961-8494-12d0f1e119fb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1358 microversion: 2.1 time: 0.158868 Dec 23 12:12:47.222094 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 617/1197] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:47 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:48.243055 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-cccc4e83-fe84-455b-a6d7-6c3437aa4ab4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:48.244026 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-cccc4e83-fe84-455b-a6d7-6c3437aa4ab4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:48.255152 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cccc4e83-fe84-455b-a6d7-6c3437aa4ab4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:48.255899 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cccc4e83-fe84-455b-a6d7-6c3437aa4ab4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:48.257170 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cccc4e83-fe84-455b-a6d7-6c3437aa4ab4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:48.257890 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cccc4e83-fe84-455b-a6d7-6c3437aa4ab4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:48.402540 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-cccc4e83-fe84-455b-a6d7-6c3437aa4ab4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:48.410854 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-cccc4e83-fe84-455b-a6d7-6c3437aa4ab4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1358 microversion: 2.1 time: 0.173924 Dec 23 12:12:48.411431 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 581/1198] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:48 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:48.571190 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-20670fe4-1caa-4333-944c-f0c6ab27d342 req-4fa93eb4-215d-4c20-9950-475b52347256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c088f48b-5f59-4c34-9fcb-5bc13dbee3ed", "name": "network-vif-plugged", "status": "completed", "tag": "0c5c9304-bccc-488a-8e51-116a85984824"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:12:48.572739 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:12:48.572739 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:12:48.580430 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-20670fe4-1caa-4333-944c-f0c6ab27d342 req-4fa93eb4-215d-4c20-9950-475b52347256 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:48.581016 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-20670fe4-1caa-4333-944c-f0c6ab27d342 req-4fa93eb4-215d-4c20-9950-475b52347256 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:48.592058 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-20670fe4-1caa-4333-944c-f0c6ab27d342 req-4fa93eb4-215d-4c20-9950-475b52347256 service nova] Creating event network-vif-plugged:0c5c9304-bccc-488a-8e51-116a85984824 for instance c088f48b-5f59-4c34-9fcb-5bc13dbee3ed on hv-cinder-82282 Dec 23 12:12:48.597018 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-20670fe4-1caa-4333-944c-f0c6ab27d342 req-4fa93eb4-215d-4c20-9950-475b52347256 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029495 Dec 23 12:12:48.597787 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 618/1199] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:12:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:12:49.431528 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-aaadadc4-2971-49a0-80f0-b6fa854a0f89 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:49.432532 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-aaadadc4-2971-49a0-80f0-b6fa854a0f89 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:49.441458 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aaadadc4-2971-49a0-80f0-b6fa854a0f89 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:49.441904 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aaadadc4-2971-49a0-80f0-b6fa854a0f89 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:49.442707 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aaadadc4-2971-49a0-80f0-b6fa854a0f89 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:49.443141 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aaadadc4-2971-49a0-80f0-b6fa854a0f89 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:49.580376 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-aaadadc4-2971-49a0-80f0-b6fa854a0f89 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:49.588558 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-aaadadc4-2971-49a0-80f0-b6fa854a0f89 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1358 microversion: 2.1 time: 0.163221 Dec 23 12:12:49.589129 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 582/1200] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:49 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:50.606834 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7d77ba63-7a1b-460b-bbbc-74378a6a290e tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:50.607868 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-7d77ba63-7a1b-460b-bbbc-74378a6a290e tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:50.615690 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7d77ba63-7a1b-460b-bbbc-74378a6a290e tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:50.616135 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7d77ba63-7a1b-460b-bbbc-74378a6a290e tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:50.616927 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7d77ba63-7a1b-460b-bbbc-74378a6a290e tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:50.617355 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7d77ba63-7a1b-460b-bbbc-74378a6a290e tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:50.972604 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-7d77ba63-7a1b-460b-bbbc-74378a6a290e tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:50.980787 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-7d77ba63-7a1b-460b-bbbc-74378a6a290e tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1546 microversion: 2.1 time: 0.378262 Dec 23 12:12:50.981536 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 619/1201] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:50 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1546 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:51.003876 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-15b2b899-2dbb-4bc0-83c1-c74e2ce27892 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:51.004504 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-15b2b899-2dbb-4bc0-83c1-c74e2ce27892 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:51.011535 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-15b2b899-2dbb-4bc0-83c1-c74e2ce27892 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:51.012019 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-15b2b899-2dbb-4bc0-83c1-c74e2ce27892 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:51.012791 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-15b2b899-2dbb-4bc0-83c1-c74e2ce27892 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:51.013228 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-15b2b899-2dbb-4bc0-83c1-c74e2ce27892 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:51.156948 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-15b2b899-2dbb-4bc0-83c1-c74e2ce27892 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:51.164733 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-15b2b899-2dbb-4bc0-83c1-c74e2ce27892 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1546 microversion: 2.1 time: 0.165401 Dec 23 12:12:51.165309 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 583/1202] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:50 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1546 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:51.180997 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-add93d70-df9c-46a1-b81f-bc78e9c9e13d tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:51.184332 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:12:51.184332 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:12:51.185322 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-add93d70-df9c-46a1-b81f-bc78e9c9e13d tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:51.186074 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-add93d70-df9c-46a1-b81f-bc78e9c9e13d tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Searching by: {'deleted': False, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820'} {{(pid=116354) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 23 12:12:51.192688 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-add93d70-df9c-46a1-b81f-bc78e9c9e13d tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:51.193138 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-add93d70-df9c-46a1-b81f-bc78e9c9e13d tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:51.193956 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-add93d70-df9c-46a1-b81f-bc78e9c9e13d tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:51.194393 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-add93d70-df9c-46a1-b81f-bc78e9c9e13d tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:51.284018 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.multi_cell_list [None req-add93d70-df9c-46a1-b81f-bc78e9c9e13d tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 23 12:12:51.386092 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-add93d70-df9c-46a1-b81f-bc78e9c9e13d tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.208615 Dec 23 12:12:51.386703 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 620/1203] 10.222.0.65 () {58 vars in 1124 bytes} [Thu Dec 23 12:12:51 2021] GET /compute/v2.1/servers => generated 342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:12:51.397347 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-0241fddd-af5c-4112-9741-f29d4d525c37 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:12:51.397974 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-0241fddd-af5c-4112-9741-f29d4d525c37 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:51.404130 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0241fddd-af5c-4112-9741-f29d4d525c37 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:51.404642 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0241fddd-af5c-4112-9741-f29d4d525c37 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:51.405354 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0241fddd-af5c-4112-9741-f29d4d525c37 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:51.405791 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-0241fddd-af5c-4112-9741-f29d4d525c37 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:51.552841 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-0241fddd-af5c-4112-9741-f29d4d525c37 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:12:51.563399 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-0241fddd-af5c-4112-9741-f29d4d525c37 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1546 microversion: 2.1 time: 0.169717 Dec 23 12:12:51.564011 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 584/1204] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:12:51 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1546 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:12:53.121445 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7774bf4f-7397-49bf-873a-052df4c64c32 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7924b88b-5ec3-468f-ada3-1fac6bf7de11"}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:12:53.122557 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-7774bf4f-7397-49bf-873a-052df4c64c32 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:12:53.129222 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7774bf4f-7397-49bf-873a-052df4c64c32 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:53.129668 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7774bf4f-7397-49bf-873a-052df4c64c32 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:53.130437 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7774bf4f-7397-49bf-873a-052df4c64c32 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:12:53.130893 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7774bf4f-7397-49bf-873a-052df4c64c32 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:12:53.422841 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-7774bf4f-7397-49bf-873a-052df4c64c32 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "POST /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305682 Dec 23 12:12:53.423593 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 621/1205] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Dec 23 12:12:53 2021] POST /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 23 12:13:01.000025 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-2e9b9f45-c4c7-414d-b04e-af986517a06a tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:01.000655 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-2e9b9f45-c4c7-414d-b04e-af986517a06a tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:01.008997 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2e9b9f45-c4c7-414d-b04e-af986517a06a tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:01.009444 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2e9b9f45-c4c7-414d-b04e-af986517a06a tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:01.010222 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2e9b9f45-c4c7-414d-b04e-af986517a06a tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:01.010716 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-2e9b9f45-c4c7-414d-b04e-af986517a06a tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:01.161486 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-2e9b9f45-c4c7-414d-b04e-af986517a06a tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:01.174256 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-2e9b9f45-c4c7-414d-b04e-af986517a06a tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1592 microversion: 2.1 time: 0.179838 Dec 23 12:13:01.174990 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 585/1206] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:00 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1592 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:02.911376 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-b09bf7d4-cfb9-46f8-8385-22113a6179f6 req-91946b9d-edfb-40fd-a14d-e98908bff0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c088f48b-5f59-4c34-9fcb-5bc13dbee3ed", "tag": "0c5c9304-bccc-488a-8e51-116a85984824"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:13:02.912952 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:13:02.912952 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:13:02.920286 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-b09bf7d4-cfb9-46f8-8385-22113a6179f6 req-91946b9d-edfb-40fd-a14d-e98908bff0f7 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:02.920727 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-b09bf7d4-cfb9-46f8-8385-22113a6179f6 req-91946b9d-edfb-40fd-a14d-e98908bff0f7 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:02.937532 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-b09bf7d4-cfb9-46f8-8385-22113a6179f6 req-91946b9d-edfb-40fd-a14d-e98908bff0f7 service nova] Creating event network-changed:0c5c9304-bccc-488a-8e51-116a85984824 for instance c088f48b-5f59-4c34-9fcb-5bc13dbee3ed on hv-cinder-82282 Dec 23 12:13:02.942805 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-b09bf7d4-cfb9-46f8-8385-22113a6179f6 req-91946b9d-edfb-40fd-a14d-e98908bff0f7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035594 Dec 23 12:13:02.943682 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 622/1207] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:13:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:13:03.945882 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-9468bff6-5c90-4113-aa2a-a9963152c519 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-568412105"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:13:03.946827 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-9468bff6-5c90-4113-aa2a-a9963152c519 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:03.953949 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9468bff6-5c90-4113-aa2a-a9963152c519 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:03.954481 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9468bff6-5c90-4113-aa2a-a9963152c519 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:03.955456 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9468bff6-5c90-4113-aa2a-a9963152c519 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:03.955893 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9468bff6-5c90-4113-aa2a-a9963152c519 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:04.090925 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.network.security_group_api [None req-9468bff6-5c90-4113-aa2a-a9963152c519 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Adding security group bdc86ebe-5fe4-4143-9917-b8ac1c958868 to port 0c5c9304-bccc-488a-8e51-116a85984824 Dec 23 12:13:04.444620 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-9468bff6-5c90-4113-aa2a-a9963152c519 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "POST /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/action" status: 202 len: 0 microversion: 2.1 time: 0.502832 Dec 23 12:13:04.446992 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 586/1208] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:13:03 2021] POST /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:13:04.456167 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8d7cf128-c3e5-4f12-a536-4ac8f73e6a91 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:04.457852 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8d7cf128-c3e5-4f12-a536-4ac8f73e6a91 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:04.465633 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d7cf128-c3e5-4f12-a536-4ac8f73e6a91 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:04.466174 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d7cf128-c3e5-4f12-a536-4ac8f73e6a91 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:04.467083 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d7cf128-c3e5-4f12-a536-4ac8f73e6a91 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:04.467589 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8d7cf128-c3e5-4f12-a536-4ac8f73e6a91 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:04.630607 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8d7cf128-c3e5-4f12-a536-4ac8f73e6a91 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:04.638672 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8d7cf128-c3e5-4f12-a536-4ac8f73e6a91 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1757 microversion: 2.1 time: 0.187200 Dec 23 12:13:04.639255 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 623/1209] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:04 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:04.958493 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-92c493bc-b9f2-4fcd-b9fe-f10f0f7f7759 req-43a5795b-8394-43c9-8c27-337d9b1307c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c088f48b-5f59-4c34-9fcb-5bc13dbee3ed", "tag": "0c5c9304-bccc-488a-8e51-116a85984824"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:13:04.960161 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:13:04.960161 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:13:04.967439 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-92c493bc-b9f2-4fcd-b9fe-f10f0f7f7759 req-43a5795b-8394-43c9-8c27-337d9b1307c6 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:04.967890 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-92c493bc-b9f2-4fcd-b9fe-f10f0f7f7759 req-43a5795b-8394-43c9-8c27-337d9b1307c6 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:04.980311 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-92c493bc-b9f2-4fcd-b9fe-f10f0f7f7759 req-43a5795b-8394-43c9-8c27-337d9b1307c6 service nova] Creating event network-changed:0c5c9304-bccc-488a-8e51-116a85984824 for instance c088f48b-5f59-4c34-9fcb-5bc13dbee3ed on hv-cinder-82282 Dec 23 12:13:04.986042 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-92c493bc-b9f2-4fcd-b9fe-f10f0f7f7759 req-43a5795b-8394-43c9-8c27-337d9b1307c6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031808 Dec 23 12:13:04.986659 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 587/1210] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:13:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:13:29.755023 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-1a0e2b15-95d0-417b-8c87-1d3b8843e0b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1807228892", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2138957045", "security_groups": [{"name": "tempest-secgroup-smoke-1922405993"}], "block_device_mapping_v2": [{"uuid": "68de0ba1-5bdf-4f2a-a2fb-8202cbc695a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cb185919-e3e9-4255-a3cb-29bc627cf289"}]}} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:13:29.868175 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.network.neutron [None req-1a0e2b15-95d0-417b-8c87-1d3b8843e0b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] validate_networks() for [('cb185919-e3e9-4255-a3cb-29bc627cf289', None, None, None, None, None)] {{(pid=116354) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 23 12:13:30.521791 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-1a0e2b15-95d0-417b-8c87-1d3b8843e0b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Flavor limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 23 12:13:30.522331 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-1a0e2b15-95d0-417b-8c87-1d3b8843e0b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Image limits 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 23 12:13:30.523027 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-1a0e2b15-95d0-417b-8c87-1d3b8843e0b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Flavor pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 23 12:13:30.523563 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-1a0e2b15-95d0-417b-8c87-1d3b8843e0b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Image pref 0:0:0 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 23 12:13:30.524010 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.virt.hardware [None req-1a0e2b15-95d0-417b-8c87-1d3b8843e0b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 23 12:13:30.536239 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1a0e2b15-95d0-417b-8c87-1d3b8843e0b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:30.536685 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1a0e2b15-95d0-417b-8c87-1d3b8843e0b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:30.537499 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1a0e2b15-95d0-417b-8c87-1d3b8843e0b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:30.538056 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-1a0e2b15-95d0-417b-8c87-1d3b8843e0b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:30.558014 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-1a0e2b15-95d0-417b-8c87-1d3b8843e0b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Getting quotas for project 65754771daec4e08922a4c10f20ca653. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 23 12:13:30.562714 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.quota [None req-1a0e2b15-95d0-417b-8c87-1d3b8843e0b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Getting quotas for user 28fb997ba3e94ce4a7cff5d5efe7d4b2 and project 65754771daec4e08922a4c10f20ca653. Resources: {'cores', 'ram', 'instances'} {{(pid=116354) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 23 12:13:30.629483 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1a0e2b15-95d0-417b-8c87-1d3b8843e0b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Going to run 1 instances... {{(pid=116354) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 23 12:13:30.631683 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-1a0e2b15-95d0-417b-8c87-1d3b8843e0b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68de0ba1-5bdf-4f2a-a2fb-8202cbc695a3',volume_size=None,volume_type=None)] {{(pid=116354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 23 12:13:30.759872 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-1a0e2b15-95d0-417b-8c87-1d3b8843e0b4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.008532 Dec 23 12:13:30.760667 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 624/1211] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Dec 23 12:13:29 2021] POST /compute/v2.1/servers => generated 406 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 23 12:13:30.771579 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-66f49e65-2a09-44e6-9d40-2a2d1f6116e0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:30.772172 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-66f49e65-2a09-44e6-9d40-2a2d1f6116e0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:30.825559 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-66f49e65-2a09-44e6-9d40-2a2d1f6116e0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:30.831969 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-66f49e65-2a09-44e6-9d40-2a2d1f6116e0 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1095 microversion: 2.1 time: 0.065224 Dec 23 12:13:30.832552 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 588/1212] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:30 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:31.849238 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-aa5b8a48-ac44-4bae-ba94-75cfe43dfb29 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:31.849890 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-aa5b8a48-ac44-4bae-ba94-75cfe43dfb29 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:31.856314 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aa5b8a48-ac44-4bae-ba94-75cfe43dfb29 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:31.856766 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aa5b8a48-ac44-4bae-ba94-75cfe43dfb29 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:31.857892 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aa5b8a48-ac44-4bae-ba94-75cfe43dfb29 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:31.858329 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-aa5b8a48-ac44-4bae-ba94-75cfe43dfb29 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:31.922068 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-aa5b8a48-ac44-4bae-ba94-75cfe43dfb29 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:31.930452 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-aa5b8a48-ac44-4bae-ba94-75cfe43dfb29 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1193 microversion: 2.1 time: 0.085409 Dec 23 12:13:31.931073 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 625/1213] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:31 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:32.947664 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-5d59f788-c298-41e1-913b-e77211d51256 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:32.948572 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-5d59f788-c298-41e1-913b-e77211d51256 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:32.956252 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5d59f788-c298-41e1-913b-e77211d51256 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:32.956801 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5d59f788-c298-41e1-913b-e77211d51256 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:32.957789 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5d59f788-c298-41e1-913b-e77211d51256 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:32.958706 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-5d59f788-c298-41e1-913b-e77211d51256 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:33.352941 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-5d59f788-c298-41e1-913b-e77211d51256 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:33.371535 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-5d59f788-c298-41e1-913b-e77211d51256 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1279 microversion: 2.1 time: 0.427760 Dec 23 12:13:33.381783 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 589/1214] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:32 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1279 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:33.561557 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-56e4e1ec-f46b-465a-8fba-90f9bd3a5883 req-03440d69-146a-4dd4-ae7e-024ded11a320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1", "tag": "c267d140-e712-43d0-9e40-a2094d5fe1b4"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:13:33.568632 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:13:33.568632 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:13:33.581550 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-56e4e1ec-f46b-465a-8fba-90f9bd3a5883 req-03440d69-146a-4dd4-ae7e-024ded11a320 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:33.581916 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-56e4e1ec-f46b-465a-8fba-90f9bd3a5883 req-03440d69-146a-4dd4-ae7e-024ded11a320 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:33.593321 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-56e4e1ec-f46b-465a-8fba-90f9bd3a5883 req-03440d69-146a-4dd4-ae7e-024ded11a320 service nova] Creating event network-changed:c267d140-e712-43d0-9e40-a2094d5fe1b4 for instance ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 on hv-cinder-82282 Dec 23 12:13:33.599133 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-56e4e1ec-f46b-465a-8fba-90f9bd3a5883 req-03440d69-146a-4dd4-ae7e-024ded11a320 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042142 Dec 23 12:13:33.599716 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 626/1215] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:13:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:13:34.389135 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-999c3428-a25f-4e69-85be-a67d2348abdd tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:34.389871 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-999c3428-a25f-4e69-85be-a67d2348abdd tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:34.396411 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-999c3428-a25f-4e69-85be-a67d2348abdd tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:34.396864 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-999c3428-a25f-4e69-85be-a67d2348abdd tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:34.397653 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-999c3428-a25f-4e69-85be-a67d2348abdd tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:34.398097 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-999c3428-a25f-4e69-85be-a67d2348abdd tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:34.611548 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-999c3428-a25f-4e69-85be-a67d2348abdd tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:34.619915 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-999c3428-a25f-4e69-85be-a67d2348abdd tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1267 microversion: 2.1 time: 0.234705 Dec 23 12:13:34.620524 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 590/1216] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:34 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:35.642785 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-5a7617ef-9221-4a10-8e82-7e3676b9b5fc tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:35.643858 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-5a7617ef-9221-4a10-8e82-7e3676b9b5fc tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:35.653603 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5a7617ef-9221-4a10-8e82-7e3676b9b5fc tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:35.654049 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5a7617ef-9221-4a10-8e82-7e3676b9b5fc tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:35.654852 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5a7617ef-9221-4a10-8e82-7e3676b9b5fc tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:35.655281 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-5a7617ef-9221-4a10-8e82-7e3676b9b5fc tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:35.859870 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-5a7617ef-9221-4a10-8e82-7e3676b9b5fc tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:35.868165 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-5a7617ef-9221-4a10-8e82-7e3676b9b5fc tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1267 microversion: 2.1 time: 0.233060 Dec 23 12:13:35.868734 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 627/1217] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:35 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:36.850206 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-53325e90-2e8e-4779-8e1f-fb1c982a0e96 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:13:36.851898 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-53325e90-2e8e-4779-8e1f-fb1c982a0e96 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:36.860289 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-53325e90-2e8e-4779-8e1f-fb1c982a0e96 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:36.860752 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-53325e90-2e8e-4779-8e1f-fb1c982a0e96 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:36.861532 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-53325e90-2e8e-4779-8e1f-fb1c982a0e96 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:36.861977 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-53325e90-2e8e-4779-8e1f-fb1c982a0e96 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:36.884857 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-636160ab-ffbe-4e15-920b-2a04c2238431 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:36.885484 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-636160ab-ffbe-4e15-920b-2a04c2238431 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:36.892590 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-636160ab-ffbe-4e15-920b-2a04c2238431 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:36.893042 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-636160ab-ffbe-4e15-920b-2a04c2238431 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:36.893811 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-636160ab-ffbe-4e15-920b-2a04c2238431 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:36.894240 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-636160ab-ffbe-4e15-920b-2a04c2238431 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:36.937051 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-53325e90-2e8e-4779-8e1f-fb1c982a0e96 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "POST /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/action" status: 202 len: 0 microversion: 2.1 time: 0.092894 Dec 23 12:13:36.939184 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 591/1218] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:13:36 2021] POST /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:13:36.946666 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8b71a42e-41b6-4db8-a0ee-f3d42043c6d7 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:36.947376 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-8b71a42e-41b6-4db8-a0ee-f3d42043c6d7 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:36.954898 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8b71a42e-41b6-4db8-a0ee-f3d42043c6d7 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:36.955161 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8b71a42e-41b6-4db8-a0ee-f3d42043c6d7 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:36.955972 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8b71a42e-41b6-4db8-a0ee-f3d42043c6d7 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:36.956524 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8b71a42e-41b6-4db8-a0ee-f3d42043c6d7 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:37.059613 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-636160ab-ffbe-4e15-920b-2a04c2238431 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:37.067419 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-636160ab-ffbe-4e15-920b-2a04c2238431 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1267 microversion: 2.1 time: 0.186221 Dec 23 12:13:37.067968 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 628/1219] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:36 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:37.193018 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-8b71a42e-41b6-4db8-a0ee-f3d42043c6d7 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:37.201830 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-8b71a42e-41b6-4db8-a0ee-f3d42043c6d7 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1749 microversion: 2.1 time: 0.259171 Dec 23 12:13:37.202380 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 592/1220] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:36 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1749 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:13:38.087817 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-542a05f5-32c9-4dd5-ad5f-5b2ae66643ad tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:38.088610 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-542a05f5-32c9-4dd5-ad5f-5b2ae66643ad tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:38.098928 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-542a05f5-32c9-4dd5-ad5f-5b2ae66643ad tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:38.099636 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-542a05f5-32c9-4dd5-ad5f-5b2ae66643ad tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:38.100940 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-542a05f5-32c9-4dd5-ad5f-5b2ae66643ad tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:38.101496 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-542a05f5-32c9-4dd5-ad5f-5b2ae66643ad tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:38.219189 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-8096c56c-6da1-4fbc-8d43-a28d71fd855e tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:38.219823 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-8096c56c-6da1-4fbc-8d43-a28d71fd855e tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:38.226537 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8096c56c-6da1-4fbc-8d43-a28d71fd855e tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:38.227009 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8096c56c-6da1-4fbc-8d43-a28d71fd855e tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:38.227803 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8096c56c-6da1-4fbc-8d43-a28d71fd855e tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:38.228241 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-8096c56c-6da1-4fbc-8d43-a28d71fd855e tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:38.239379 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-542a05f5-32c9-4dd5-ad5f-5b2ae66643ad tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:38.247345 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-542a05f5-32c9-4dd5-ad5f-5b2ae66643ad tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1267 microversion: 2.1 time: 0.165560 Dec 23 12:13:38.248171 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 629/1221] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:38 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:38.380240 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-8096c56c-6da1-4fbc-8d43-a28d71fd855e tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:38.390555 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-8096c56c-6da1-4fbc-8d43-a28d71fd855e tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1754 microversion: 2.1 time: 0.175079 Dec 23 12:13:38.391154 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 593/1222] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:38 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:39.267147 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e34df4ef-d07d-4687-b18d-d6c3bcd3f48c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:39.268158 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e34df4ef-d07d-4687-b18d-d6c3bcd3f48c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:39.280304 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e34df4ef-d07d-4687-b18d-d6c3bcd3f48c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:39.280793 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e34df4ef-d07d-4687-b18d-d6c3bcd3f48c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:39.281591 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e34df4ef-d07d-4687-b18d-d6c3bcd3f48c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:39.282028 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e34df4ef-d07d-4687-b18d-d6c3bcd3f48c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:39.408471 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-f1ab8c3a-eabf-4a23-af82-c20515df1ab7 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:39.409057 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-f1ab8c3a-eabf-4a23-af82-c20515df1ab7 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:39.415816 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f1ab8c3a-eabf-4a23-af82-c20515df1ab7 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:39.416302 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f1ab8c3a-eabf-4a23-af82-c20515df1ab7 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:39.417132 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f1ab8c3a-eabf-4a23-af82-c20515df1ab7 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:39.417593 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-f1ab8c3a-eabf-4a23-af82-c20515df1ab7 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:39.421140 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e34df4ef-d07d-4687-b18d-d6c3bcd3f48c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:39.428501 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e34df4ef-d07d-4687-b18d-d6c3bcd3f48c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1267 microversion: 2.1 time: 0.167535 Dec 23 12:13:39.429046 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 630/1223] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:39 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:39.560820 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-f1ab8c3a-eabf-4a23-af82-c20515df1ab7 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:39.568986 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-f1ab8c3a-eabf-4a23-af82-c20515df1ab7 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1754 microversion: 2.1 time: 0.164204 Dec 23 12:13:39.569556 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 594/1224] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:39 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:40.449318 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-db252648-2ea1-4728-8470-f3ef81c7b92a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:40.450184 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-db252648-2ea1-4728-8470-f3ef81c7b92a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:40.458879 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-db252648-2ea1-4728-8470-f3ef81c7b92a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:40.459473 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-db252648-2ea1-4728-8470-f3ef81c7b92a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:40.460495 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-db252648-2ea1-4728-8470-f3ef81c7b92a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:40.461064 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-db252648-2ea1-4728-8470-f3ef81c7b92a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:40.586279 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ebda2b1f-ae75-43ae-8286-c9539fba615b tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:40.586930 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-ebda2b1f-ae75-43ae-8286-c9539fba615b tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:40.593115 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ebda2b1f-ae75-43ae-8286-c9539fba615b tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:40.593569 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ebda2b1f-ae75-43ae-8286-c9539fba615b tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:40.594355 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ebda2b1f-ae75-43ae-8286-c9539fba615b tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:40.594827 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-ebda2b1f-ae75-43ae-8286-c9539fba615b tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:40.604144 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-db252648-2ea1-4728-8470-f3ef81c7b92a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:40.612258 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-db252648-2ea1-4728-8470-f3ef81c7b92a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1267 microversion: 2.1 time: 0.169307 Dec 23 12:13:40.612739 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 631/1225] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:40 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:40.735843 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-ebda2b1f-ae75-43ae-8286-c9539fba615b tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:40.743710 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ebda2b1f-ae75-43ae-8286-c9539fba615b tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1754 microversion: 2.1 time: 0.161385 Dec 23 12:13:40.744319 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 595/1226] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:40 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:41.633181 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-4e6d674e-eb19-4926-8d48-386ca3bcffb1 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:41.634104 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-4e6d674e-eb19-4926-8d48-386ca3bcffb1 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:41.645024 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4e6d674e-eb19-4926-8d48-386ca3bcffb1 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:41.645770 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4e6d674e-eb19-4926-8d48-386ca3bcffb1 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:41.647107 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4e6d674e-eb19-4926-8d48-386ca3bcffb1 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:41.647822 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-4e6d674e-eb19-4926-8d48-386ca3bcffb1 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:41.761316 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-27497908-f169-4ded-b144-aeb690e93247 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:41.762540 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-27497908-f169-4ded-b144-aeb690e93247 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:41.769396 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-27497908-f169-4ded-b144-aeb690e93247 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:41.769863 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-27497908-f169-4ded-b144-aeb690e93247 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:41.770681 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-27497908-f169-4ded-b144-aeb690e93247 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:41.771123 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-27497908-f169-4ded-b144-aeb690e93247 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:41.798878 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-4e6d674e-eb19-4926-8d48-386ca3bcffb1 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:41.806703 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-4e6d674e-eb19-4926-8d48-386ca3bcffb1 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1267 microversion: 2.1 time: 0.179744 Dec 23 12:13:41.815908 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 632/1227] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:41 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:41.918333 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-27497908-f169-4ded-b144-aeb690e93247 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:41.927143 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-27497908-f169-4ded-b144-aeb690e93247 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1754 microversion: 2.1 time: 0.169654 Dec 23 12:13:41.927714 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 596/1228] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:41 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:42.823587 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-b8658b4f-e7f6-4230-831f-ca826365a469 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:42.824203 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-b8658b4f-e7f6-4230-831f-ca826365a469 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:42.831760 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b8658b4f-e7f6-4230-831f-ca826365a469 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:42.832302 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b8658b4f-e7f6-4230-831f-ca826365a469 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:42.833322 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b8658b4f-e7f6-4230-831f-ca826365a469 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:42.833786 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-b8658b4f-e7f6-4230-831f-ca826365a469 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:42.944421 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-bef4dbae-a26c-4f17-aca5-1571b5805c00 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:42.945143 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-bef4dbae-a26c-4f17-aca5-1571b5805c00 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:42.952023 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bef4dbae-a26c-4f17-aca5-1571b5805c00 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:42.952559 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bef4dbae-a26c-4f17-aca5-1571b5805c00 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:42.953421 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bef4dbae-a26c-4f17-aca5-1571b5805c00 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:42.953954 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-bef4dbae-a26c-4f17-aca5-1571b5805c00 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:42.966992 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-b8658b4f-e7f6-4230-831f-ca826365a469 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:42.974745 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-b8658b4f-e7f6-4230-831f-ca826365a469 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1267 microversion: 2.1 time: 0.154803 Dec 23 12:13:42.975258 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 633/1229] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:42 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:43.120351 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-bef4dbae-a26c-4f17-aca5-1571b5805c00 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:43.128946 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-bef4dbae-a26c-4f17-aca5-1571b5805c00 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1754 microversion: 2.1 time: 0.188240 Dec 23 12:13:43.129515 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 597/1230] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:42 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1754 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:43.995875 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e8ee0cad-f5bb-40db-a982-18d39f75acb4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:43.996995 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e8ee0cad-f5bb-40db-a982-18d39f75acb4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:44.007685 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e8ee0cad-f5bb-40db-a982-18d39f75acb4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:44.008428 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e8ee0cad-f5bb-40db-a982-18d39f75acb4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:44.009697 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e8ee0cad-f5bb-40db-a982-18d39f75acb4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:44.010418 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e8ee0cad-f5bb-40db-a982-18d39f75acb4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:44.145209 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-9da50462-7784-414e-855f-67211e9ddbf2 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:44.145858 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-9da50462-7784-414e-855f-67211e9ddbf2 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:44.147484 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e8ee0cad-f5bb-40db-a982-18d39f75acb4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:44.152627 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9da50462-7784-414e-855f-67211e9ddbf2 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:44.153359 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9da50462-7784-414e-855f-67211e9ddbf2 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:44.154143 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9da50462-7784-414e-855f-67211e9ddbf2 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:44.154607 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-9da50462-7784-414e-855f-67211e9ddbf2 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:44.155251 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e8ee0cad-f5bb-40db-a982-18d39f75acb4 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1267 microversion: 2.1 time: 0.165703 Dec 23 12:13:44.155821 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 634/1231] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:43 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:44.304548 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-9da50462-7784-414e-855f-67211e9ddbf2 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:44.313419 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-9da50462-7784-414e-855f-67211e9ddbf2 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1754 microversion: 2.1 time: 0.171877 Dec 23 12:13:44.313998 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 598/1232] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:44 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:44.781563 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-aee95737-9114-451f-8e74-a14387049059 req-918ed2b6-4fe0-441c-bfa6-3fe15f6391f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1", "name": "network-vif-plugged", "status": "completed", "tag": "c267d140-e712-43d0-9e40-a2094d5fe1b4"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:13:44.783147 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:13:44.783147 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:13:44.790811 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-aee95737-9114-451f-8e74-a14387049059 req-918ed2b6-4fe0-441c-bfa6-3fe15f6391f1 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:44.791260 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-aee95737-9114-451f-8e74-a14387049059 req-918ed2b6-4fe0-441c-bfa6-3fe15f6391f1 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:44.802456 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-aee95737-9114-451f-8e74-a14387049059 req-918ed2b6-4fe0-441c-bfa6-3fe15f6391f1 service nova] Creating event network-vif-plugged:c267d140-e712-43d0-9e40-a2094d5fe1b4 for instance ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 on hv-cinder-82282 Dec 23 12:13:44.807577 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-aee95737-9114-451f-8e74-a14387049059 req-918ed2b6-4fe0-441c-bfa6-3fe15f6391f1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029647 Dec 23 12:13:44.808225 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 635/1233] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:13:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:13:45.172415 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-6a6e01f9-bc96-4692-8dcb-c573bc0e305d tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:45.173057 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-6a6e01f9-bc96-4692-8dcb-c573bc0e305d tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:45.180782 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6a6e01f9-bc96-4692-8dcb-c573bc0e305d tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:45.181258 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6a6e01f9-bc96-4692-8dcb-c573bc0e305d tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:45.182039 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6a6e01f9-bc96-4692-8dcb-c573bc0e305d tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:45.182495 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6a6e01f9-bc96-4692-8dcb-c573bc0e305d tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:45.333535 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e55fb84a-7866-47c3-9c4f-81428a258902 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:45.334104 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e55fb84a-7866-47c3-9c4f-81428a258902 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:45.340603 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e55fb84a-7866-47c3-9c4f-81428a258902 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:45.341050 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e55fb84a-7866-47c3-9c4f-81428a258902 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:45.341342 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-6a6e01f9-bc96-4692-8dcb-c573bc0e305d tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:45.342089 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e55fb84a-7866-47c3-9c4f-81428a258902 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:45.342744 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e55fb84a-7866-47c3-9c4f-81428a258902 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:45.350018 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-6a6e01f9-bc96-4692-8dcb-c573bc0e305d tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1267 microversion: 2.1 time: 0.181648 Dec 23 12:13:45.350608 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 599/1234] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:45 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:45.508121 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e55fb84a-7866-47c3-9c4f-81428a258902 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:45.516251 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e55fb84a-7866-47c3-9c4f-81428a258902 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1754 microversion: 2.1 time: 0.187352 Dec 23 12:13:45.516829 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 636/1235] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:45 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1754 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:46.370060 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-aef067ea-7a5a-4c22-88a0-b6eff04e165a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:46.370800 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-aef067ea-7a5a-4c22-88a0-b6eff04e165a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:46.380683 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aef067ea-7a5a-4c22-88a0-b6eff04e165a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:46.381301 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aef067ea-7a5a-4c22-88a0-b6eff04e165a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:46.382400 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aef067ea-7a5a-4c22-88a0-b6eff04e165a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:46.383030 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-aef067ea-7a5a-4c22-88a0-b6eff04e165a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:46.533804 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a0965d9e-c569-4f2a-9be5-4dc8f6a3db51 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:46.534357 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-aef067ea-7a5a-4c22-88a0-b6eff04e165a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:46.534489 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a0965d9e-c569-4f2a-9be5-4dc8f6a3db51 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:46.541030 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a0965d9e-c569-4f2a-9be5-4dc8f6a3db51 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:46.541487 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a0965d9e-c569-4f2a-9be5-4dc8f6a3db51 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:46.541908 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-aef067ea-7a5a-4c22-88a0-b6eff04e165a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1267 microversion: 2.1 time: 0.177524 Dec 23 12:13:46.542239 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a0965d9e-c569-4f2a-9be5-4dc8f6a3db51 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:46.542493 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 600/1236] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:46 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:46.542916 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a0965d9e-c569-4f2a-9be5-4dc8f6a3db51 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:46.697543 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-a0965d9e-c569-4f2a-9be5-4dc8f6a3db51 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:46.706352 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a0965d9e-c569-4f2a-9be5-4dc8f6a3db51 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1754 microversion: 2.1 time: 0.176596 Dec 23 12:13:46.706962 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 637/1237] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:46 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:13:47.561307 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-4ff18c81-b950-481e-98bb-07910a3c25d8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:47.561924 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-4ff18c81-b950-481e-98bb-07910a3c25d8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:47.569475 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4ff18c81-b950-481e-98bb-07910a3c25d8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:47.569990 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4ff18c81-b950-481e-98bb-07910a3c25d8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:47.570890 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4ff18c81-b950-481e-98bb-07910a3c25d8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:47.571375 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-4ff18c81-b950-481e-98bb-07910a3c25d8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:47.706643 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-4ff18c81-b950-481e-98bb-07910a3c25d8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:47.714098 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-4ff18c81-b950-481e-98bb-07910a3c25d8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1453 microversion: 2.1 time: 0.158099 Dec 23 12:13:47.714697 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 601/1238] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:47 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:47.727202 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-8aac1d4f-d996-4dfc-bcb8-a7eac5e18455 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:47.727939 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-8aac1d4f-d996-4dfc-bcb8-a7eac5e18455 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:47.730121 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-7166e888-bc1d-41b5-bf0b-d47e738d3a63 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:47.730772 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-7166e888-bc1d-41b5-bf0b-d47e738d3a63 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:47.734971 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8aac1d4f-d996-4dfc-bcb8-a7eac5e18455 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:47.735431 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8aac1d4f-d996-4dfc-bcb8-a7eac5e18455 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:47.736221 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8aac1d4f-d996-4dfc-bcb8-a7eac5e18455 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:47.736679 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-8aac1d4f-d996-4dfc-bcb8-a7eac5e18455 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:47.737155 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7166e888-bc1d-41b5-bf0b-d47e738d3a63 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:47.737611 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7166e888-bc1d-41b5-bf0b-d47e738d3a63 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:47.738388 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7166e888-bc1d-41b5-bf0b-d47e738d3a63 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:47.738889 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-7166e888-bc1d-41b5-bf0b-d47e738d3a63 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:47.945547 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-7166e888-bc1d-41b5-bf0b-d47e738d3a63 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:47.950879 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-8aac1d4f-d996-4dfc-bcb8-a7eac5e18455 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:47.953662 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-7166e888-bc1d-41b5-bf0b-d47e738d3a63 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1453 microversion: 2.1 time: 0.226879 Dec 23 12:13:47.954240 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 602/1239] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:47 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1453 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:47.959647 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-8aac1d4f-d996-4dfc-bcb8-a7eac5e18455 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1754 microversion: 2.1 time: 0.236091 Dec 23 12:13:47.960402 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 638/1240] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:47 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1754 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:48.977160 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e8800480-8e33-4bc8-90db-6e0530017eb4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:13:48.977822 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-e8800480-8e33-4bc8-90db-6e0530017eb4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:13:48.985338 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e8800480-8e33-4bc8-90db-6e0530017eb4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:48.985788 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e8800480-8e33-4bc8-90db-6e0530017eb4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:48.986619 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e8800480-8e33-4bc8-90db-6e0530017eb4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:48.987057 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-e8800480-8e33-4bc8-90db-6e0530017eb4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:49.321017 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-e8800480-8e33-4bc8-90db-6e0530017eb4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:13:49.329132 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e8800480-8e33-4bc8-90db-6e0530017eb4 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1757 microversion: 2.1 time: 0.355767 Dec 23 12:13:49.329752 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 603/1241] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:13:48 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1757 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:13:50.068709 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-93a631e1-2821-4c06-9d52-b3a0302cc587 req-6e7023f1-f826-4a1c-8573-ebe160f405a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1", "tag": "c267d140-e712-43d0-9e40-a2094d5fe1b4"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:13:50.070217 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:13:50.070217 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:13:50.077609 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-93a631e1-2821-4c06-9d52-b3a0302cc587 req-6e7023f1-f826-4a1c-8573-ebe160f405a6 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:13:50.078045 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-93a631e1-2821-4c06-9d52-b3a0302cc587 req-6e7023f1-f826-4a1c-8573-ebe160f405a6 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:13:50.089195 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-93a631e1-2821-4c06-9d52-b3a0302cc587 req-6e7023f1-f826-4a1c-8573-ebe160f405a6 service nova] Creating event network-changed:c267d140-e712-43d0-9e40-a2094d5fe1b4 for instance ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 on hv-cinder-82282 Dec 23 12:13:50.094346 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-93a631e1-2821-4c06-9d52-b3a0302cc587 req-6e7023f1-f826-4a1c-8573-ebe160f405a6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029260 Dec 23 12:13:50.094971 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 639/1242] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:13:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:14:29.511077 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 23 12:14:29.511717 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: Thu Dec 23 12:14:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 23 12:14:52.869717 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-43de89d8-581c-4a66-8d19-ac78b6e9d8de tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-568412105"}} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:14:52.870883 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-43de89d8-581c-4a66-8d19-ac78b6e9d8de tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:14:52.880949 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-43de89d8-581c-4a66-8d19-ac78b6e9d8de tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:52.881694 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-43de89d8-581c-4a66-8d19-ac78b6e9d8de tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:52.883005 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-43de89d8-581c-4a66-8d19-ac78b6e9d8de tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:52.883918 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-43de89d8-581c-4a66-8d19-ac78b6e9d8de tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:53.030203 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.network.security_group_api [None req-43de89d8-581c-4a66-8d19-ac78b6e9d8de tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Removing security group bdc86ebe-5fe4-4143-9917-b8ac1c958868 from port 0c5c9304-bccc-488a-8e51-116a85984824 Dec 23 12:14:53.376685 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-43de89d8-581c-4a66-8d19-ac78b6e9d8de tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "POST /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/action" status: 202 len: 0 microversion: 2.1 time: 0.515280 Dec 23 12:14:53.377493 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 604/1243] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Dec 23 12:14:52 2021] POST /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:14:53.485476 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-05bb5096-2d85-4ba7-83b2-a213773c44ec req-2c9dc7de-bde0-4852-a85c-48ae8ca1ad59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c088f48b-5f59-4c34-9fcb-5bc13dbee3ed", "tag": "0c5c9304-bccc-488a-8e51-116a85984824"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:14:53.487138 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:14:53.487138 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:14:53.495163 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-05bb5096-2d85-4ba7-83b2-a213773c44ec req-2c9dc7de-bde0-4852-a85c-48ae8ca1ad59 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:53.495882 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-05bb5096-2d85-4ba7-83b2-a213773c44ec req-2c9dc7de-bde0-4852-a85c-48ae8ca1ad59 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:53.515075 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-05bb5096-2d85-4ba7-83b2-a213773c44ec req-2c9dc7de-bde0-4852-a85c-48ae8ca1ad59 service nova] Creating event network-changed:0c5c9304-bccc-488a-8e51-116a85984824 for instance c088f48b-5f59-4c34-9fcb-5bc13dbee3ed on hv-cinder-82282 Dec 23 12:14:53.520705 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-05bb5096-2d85-4ba7-83b2-a213773c44ec req-2c9dc7de-bde0-4852-a85c-48ae8ca1ad59 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138736 Dec 23 12:14:53.521933 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 640/1244] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:14:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:14:54.968350 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-a50227c8-40fe-46cf-ab52-311f6c8d8582 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:14:54.969538 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-a50227c8-40fe-46cf-ab52-311f6c8d8582 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:14:54.975853 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a50227c8-40fe-46cf-ab52-311f6c8d8582 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:54.976310 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a50227c8-40fe-46cf-ab52-311f6c8d8582 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:54.977106 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a50227c8-40fe-46cf-ab52-311f6c8d8582 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:54.977543 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-a50227c8-40fe-46cf-ab52-311f6c8d8582 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:55.067824 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.objects.instance [None req-a50227c8-40fe-46cf-ab52-311f6c8d8582 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lazy-loading 'services' on Instance uuid c088f48b-5f59-4c34-9fcb-5bc13dbee3ed {{(pid=116355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:14:55.158763 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-a50227c8-40fe-46cf-ab52-311f6c8d8582 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/os-volume_attachments/7924b88b-5ec3-468f-ada3-1fac6bf7de11" status: 202 len: 0 microversion: 2.1 time: 0.194731 Dec 23 12:14:55.160357 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 605/1245] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Dec 23 12:14:54 2021] DELETE /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/os-volume_attachments/7924b88b-5ec3-468f-ada3-1fac6bf7de11 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:14:55.170131 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-80128abd-25c4-4bd5-94c7-288dd5f8fa19 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:14:55.180005 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-80128abd-25c4-4bd5-94c7-288dd5f8fa19 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:14:55.190868 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-80128abd-25c4-4bd5-94c7-288dd5f8fa19 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:55.191645 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-80128abd-25c4-4bd5-94c7-288dd5f8fa19 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:55.192804 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-80128abd-25c4-4bd5-94c7-288dd5f8fa19 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:55.193407 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-80128abd-25c4-4bd5-94c7-288dd5f8fa19 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:55.225315 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-80128abd-25c4-4bd5-94c7-288dd5f8fa19 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059957 Dec 23 12:14:55.225980 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 641/1246] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:14:55 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:14:55.536830 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-4328f083-65bc-42e5-b689-af23116ef8a3 req-94fddc8d-fe6e-4a73-a28c-f70a32344df3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c088f48b-5f59-4c34-9fcb-5bc13dbee3ed", "tag": "0c5c9304-bccc-488a-8e51-116a85984824"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:14:55.538348 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:14:55.538348 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:14:55.545673 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-4328f083-65bc-42e5-b689-af23116ef8a3 req-94fddc8d-fe6e-4a73-a28c-f70a32344df3 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:55.546126 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-4328f083-65bc-42e5-b689-af23116ef8a3 req-94fddc8d-fe6e-4a73-a28c-f70a32344df3 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:55.558574 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-4328f083-65bc-42e5-b689-af23116ef8a3 req-94fddc8d-fe6e-4a73-a28c-f70a32344df3 service nova] Creating event network-changed:0c5c9304-bccc-488a-8e51-116a85984824 for instance c088f48b-5f59-4c34-9fcb-5bc13dbee3ed on hv-cinder-82282 Dec 23 12:14:55.563831 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-4328f083-65bc-42e5-b689-af23116ef8a3 req-94fddc8d-fe6e-4a73-a28c-f70a32344df3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031026 Dec 23 12:14:55.564508 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 606/1247] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:14:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:14:56.237907 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-50df9c5e-57f3-467f-bd86-4a9b386d9687 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:14:56.238884 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-50df9c5e-57f3-467f-bd86-4a9b386d9687 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:14:56.246239 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-50df9c5e-57f3-467f-bd86-4a9b386d9687 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:56.246715 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-50df9c5e-57f3-467f-bd86-4a9b386d9687 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:56.247658 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-50df9c5e-57f3-467f-bd86-4a9b386d9687 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:56.248094 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-50df9c5e-57f3-467f-bd86-4a9b386d9687 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:56.278429 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-50df9c5e-57f3-467f-bd86-4a9b386d9687 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Dec 23 12:14:56.279027 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 642/1248] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:14:56 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:14:57.293878 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-cc146d1c-de0a-4486-812f-4bd10c2c7f11 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:14:57.295096 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-cc146d1c-de0a-4486-812f-4bd10c2c7f11 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:14:57.303218 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cc146d1c-de0a-4486-812f-4bd10c2c7f11 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:57.303746 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cc146d1c-de0a-4486-812f-4bd10c2c7f11 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:57.304708 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cc146d1c-de0a-4486-812f-4bd10c2c7f11 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:57.305224 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-cc146d1c-de0a-4486-812f-4bd10c2c7f11 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:57.346046 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-cc146d1c-de0a-4486-812f-4bd10c2c7f11 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058468 Dec 23 12:14:57.346909 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 607/1249] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Dec 23 12:14:57 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 23 12:14:57.356493 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c28c0385-5ee9-4f5e-ae7d-3cefa2b37641 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:14:57.357041 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-c28c0385-5ee9-4f5e-ae7d-3cefa2b37641 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:14:57.364198 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c28c0385-5ee9-4f5e-ae7d-3cefa2b37641 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:57.364658 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c28c0385-5ee9-4f5e-ae7d-3cefa2b37641 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:57.365436 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c28c0385-5ee9-4f5e-ae7d-3cefa2b37641 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:57.365869 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-c28c0385-5ee9-4f5e-ae7d-3cefa2b37641 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:57.438855 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-c28c0385-5ee9-4f5e-ae7d-3cefa2b37641 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] HTTP exception thrown: Instance c088f48b-5f59-4c34-9fcb-5bc13dbee3ed is not attached to volume 7924b88b-5ec3-468f-ada3-1fac6bf7de11 Dec 23 12:14:57.439461 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-c28c0385-5ee9-4f5e-ae7d-3cefa2b37641 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Returning 404 to user: Instance c088f48b-5f59-4c34-9fcb-5bc13dbee3ed is not attached to volume 7924b88b-5ec3-468f-ada3-1fac6bf7de11 {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:14:57.440303 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-c28c0385-5ee9-4f5e-ae7d-3cefa2b37641 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/os-volume_attachments/7924b88b-5ec3-468f-ada3-1fac6bf7de11" status: 404 len: 154 microversion: 2.1 time: 0.087746 Dec 23 12:14:57.440824 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 643/1250] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Dec 23 12:14:57 2021] DELETE /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed/os-volume_attachments/7924b88b-5ec3-468f-ada3-1fac6bf7de11 => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:14:58.582862 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-6b0b2055-7d77-4fd3-b8ec-6f21fb9d2001 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:14:58.583389 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-6b0b2055-7d77-4fd3-b8ec-6f21fb9d2001 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:14:58.590302 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6b0b2055-7d77-4fd3-b8ec-6f21fb9d2001 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:58.590797 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6b0b2055-7d77-4fd3-b8ec-6f21fb9d2001 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:58.591567 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6b0b2055-7d77-4fd3-b8ec-6f21fb9d2001 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:58.591997 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-6b0b2055-7d77-4fd3-b8ec-6f21fb9d2001 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:58.616486 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-6b0b2055-7d77-4fd3-b8ec-6f21fb9d2001 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Going to try to terminate instance {{(pid=116355) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:14:58.707289 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-6b0b2055-7d77-4fd3-b8ec-6f21fb9d2001 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 204 len: 0 microversion: 2.1 time: 0.127832 Dec 23 12:14:58.708172 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 608/1251] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:14:58 2021] DELETE /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:14:58.716537 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-2df84d4d-1caf-478c-a4bb-032fbdc41849 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:14:58.717230 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-2df84d4d-1caf-478c-a4bb-032fbdc41849 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:14:58.723677 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2df84d4d-1caf-478c-a4bb-032fbdc41849 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:58.724126 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2df84d4d-1caf-478c-a4bb-032fbdc41849 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:58.725075 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2df84d4d-1caf-478c-a4bb-032fbdc41849 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:58.725514 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-2df84d4d-1caf-478c-a4bb-032fbdc41849 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:58.873097 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-2df84d4d-1caf-478c-a4bb-032fbdc41849 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:14:58.881108 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-2df84d4d-1caf-478c-a4bb-032fbdc41849 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1552 microversion: 2.1 time: 0.168336 Dec 23 12:14:58.881667 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 644/1252] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:14:58 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:14:59.899448 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-580823a8-8b41-416a-8a4c-f890c0b1c3da tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:14:59.900100 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-580823a8-8b41-416a-8a4c-f890c0b1c3da tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:14:59.907015 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-580823a8-8b41-416a-8a4c-f890c0b1c3da tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:59.907462 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-580823a8-8b41-416a-8a4c-f890c0b1c3da tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:14:59.908232 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-580823a8-8b41-416a-8a4c-f890c0b1c3da tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:14:59.908664 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-580823a8-8b41-416a-8a4c-f890c0b1c3da tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:00.043336 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-580823a8-8b41-416a-8a4c-f890c0b1c3da tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:15:00.050909 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-580823a8-8b41-416a-8a4c-f890c0b1c3da tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1552 microversion: 2.1 time: 0.155524 Dec 23 12:15:00.051482 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 609/1253] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:14:59 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:15:01.070475 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e651a43f-e07a-425b-b162-b61e92a8c8c6 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:01.071256 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e651a43f-e07a-425b-b162-b61e92a8c8c6 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:15:01.079798 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e651a43f-e07a-425b-b162-b61e92a8c8c6 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:01.080362 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e651a43f-e07a-425b-b162-b61e92a8c8c6 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:01.081322 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e651a43f-e07a-425b-b162-b61e92a8c8c6 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:01.081858 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e651a43f-e07a-425b-b162-b61e92a8c8c6 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:01.287562 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-e651a43f-e07a-425b-b162-b61e92a8c8c6 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e2a6e84ef54db284199ad0d460ca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261f3dd2fce84f6ba9012d9b2b7b8820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:15:01.295598 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e651a43f-e07a-425b-b162-b61e92a8c8c6 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 200 len: 1552 microversion: 2.1 time: 0.229742 Dec 23 12:15:01.296159 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 645/1254] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:15:01 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 1552 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:15:01.665179 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-0961474c-b2cb-4615-b000-d8a11cd52109 req-b547ac40-5e8d-48c9-9fa1-7c2c2897d18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c088f48b-5f59-4c34-9fcb-5bc13dbee3ed", "name": "network-vif-deleted", "tag": "0c5c9304-bccc-488a-8e51-116a85984824"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:15:01.667508 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:15:01.667508 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:15:01.675536 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-0961474c-b2cb-4615-b000-d8a11cd52109 req-b547ac40-5e8d-48c9-9fa1-7c2c2897d18e service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:01.675984 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-0961474c-b2cb-4615-b000-d8a11cd52109 req-b547ac40-5e8d-48c9-9fa1-7c2c2897d18e service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:01.687201 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-0961474c-b2cb-4615-b000-d8a11cd52109 req-b547ac40-5e8d-48c9-9fa1-7c2c2897d18e service nova] Creating event network-vif-deleted:0c5c9304-bccc-488a-8e51-116a85984824 for instance c088f48b-5f59-4c34-9fcb-5bc13dbee3ed on hv-cinder-82282 Dec 23 12:15:01.691937 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-0961474c-b2cb-4615-b000-d8a11cd52109 req-b547ac40-5e8d-48c9-9fa1-7c2c2897d18e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030892 Dec 23 12:15:01.692500 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 610/1255] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:15:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:15:02.313200 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a03ee1ce-dbb0-4897-b22e-cdce42eff0bb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:02.313861 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-a03ee1ce-dbb0-4897-b22e-cdce42eff0bb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] [instance: c088f48b-5f59-4c34-9fcb-5bc13dbee3ed] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:15:02.320991 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a03ee1ce-dbb0-4897-b22e-cdce42eff0bb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:02.321452 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a03ee1ce-dbb0-4897-b22e-cdce42eff0bb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:02.322245 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a03ee1ce-dbb0-4897-b22e-cdce42eff0bb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:02.322716 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-a03ee1ce-dbb0-4897-b22e-cdce42eff0bb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:02.336637 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-a03ee1ce-dbb0-4897-b22e-cdce42eff0bb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] HTTP exception thrown: Instance c088f48b-5f59-4c34-9fcb-5bc13dbee3ed could not be found. Dec 23 12:15:02.337262 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-a03ee1ce-dbb0-4897-b22e-cdce42eff0bb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Returning 404 to user: Instance c088f48b-5f59-4c34-9fcb-5bc13dbee3ed could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:15:02.338096 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-a03ee1ce-dbb0-4897-b22e-cdce42eff0bb tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed" status: 404 len: 111 microversion: 2.1 time: 0.029524 Dec 23 12:15:02.338903 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 646/1256] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:15:02 2021] GET /compute/v2.1/servers/c088f48b-5f59-4c34-9fcb-5bc13dbee3ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:15:02.347796 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-e0ca5d05-8835-46fb-a617-d47586028c75 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] Calling method '.version_select at 0x7fcf287500d0>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:02.374581 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-e0ca5d05-8835-46fb-a617-d47586028c75 tempest-TestMinimumBasicScenario-1254899652 tempest-TestMinimumBasicScenario-1254899652-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1771458219" status: 202 len: 0 microversion: 2.1 time: 0.030720 Dec 23 12:15:02.375170 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 611/1257] 10.222.0.65 () {58 vars in 1271 bytes} [Thu Dec 23 12:15:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1771458219 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:15:20.070853 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 23 12:15:20.072013 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: Thu Dec 23 12:15:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 23 12:15:25.266988 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 23 12:15:25.267871 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: Thu Dec 23 12:15:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 23 12:15:40.090389 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-294da59b-805d-47a3-807d-a784d7ac423f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:40.090966 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-294da59b-805d-47a3-807d-a784d7ac423f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:15:40.103938 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-294da59b-805d-47a3-807d-a784d7ac423f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:40.104394 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-294da59b-805d-47a3-807d-a784d7ac423f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:40.105202 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-294da59b-805d-47a3-807d-a784d7ac423f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:40.105635 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-294da59b-805d-47a3-807d-a784d7ac423f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:40.132500 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-294da59b-805d-47a3-807d-a784d7ac423f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Going to try to terminate instance {{(pid=116354) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:15:40.216666 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-294da59b-805d-47a3-807d-a784d7ac423f tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 204 len: 0 microversion: 2.1 time: 0.129578 Dec 23 12:15:40.217898 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 647/1258] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:15:40 2021] DELETE /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:15:40.228861 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-59191436-99c8-40cf-bc21-ec39fe0ad673 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:40.230076 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-59191436-99c8-40cf-bc21-ec39fe0ad673 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:15:40.236327 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-59191436-99c8-40cf-bc21-ec39fe0ad673 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:40.236780 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-59191436-99c8-40cf-bc21-ec39fe0ad673 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:40.237571 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-59191436-99c8-40cf-bc21-ec39fe0ad673 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:40.238225 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-59191436-99c8-40cf-bc21-ec39fe0ad673 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:40.295182 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-71c7ba72-3974-4719-9512-c7364f31e4a4 req-53f24453-f7c8-45cd-bced-67ceb72826ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1", "tag": "c267d140-e712-43d0-9e40-a2094d5fe1b4"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:15:40.297260 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:15:40.297260 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:15:40.305797 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-71c7ba72-3974-4719-9512-c7364f31e4a4 req-53f24453-f7c8-45cd-bced-67ceb72826ae service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:40.306743 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-71c7ba72-3974-4719-9512-c7364f31e4a4 req-53f24453-f7c8-45cd-bced-67ceb72826ae service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:40.316810 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-71c7ba72-3974-4719-9512-c7364f31e4a4 req-53f24453-f7c8-45cd-bced-67ceb72826ae service nova] Creating event network-changed:c267d140-e712-43d0-9e40-a2094d5fe1b4 for instance ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 on hv-cinder-82282 Dec 23 12:15:40.322334 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-71c7ba72-3974-4719-9512-c7364f31e4a4 req-53f24453-f7c8-45cd-bced-67ceb72826ae service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228888 Dec 23 12:15:40.326117 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 612/1259] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:15:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:15:40.380279 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-59191436-99c8-40cf-bc21-ec39fe0ad673 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:15:40.388236 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-59191436-99c8-40cf-bc21-ec39fe0ad673 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1577 microversion: 2.1 time: 0.165771 Dec 23 12:15:40.399228 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 648/1260] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:15:40 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 23 12:15:41.411207 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-584d7ddc-2f88-4cf8-a8f4-077c859028fc tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:41.411913 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-584d7ddc-2f88-4cf8-a8f4-077c859028fc tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:15:41.418636 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-584d7ddc-2f88-4cf8-a8f4-077c859028fc tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:41.419128 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-584d7ddc-2f88-4cf8-a8f4-077c859028fc tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:41.419901 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-584d7ddc-2f88-4cf8-a8f4-077c859028fc tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:41.420349 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-584d7ddc-2f88-4cf8-a8f4-077c859028fc tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:41.568308 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-584d7ddc-2f88-4cf8-a8f4-077c859028fc tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:15:41.579764 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-584d7ddc-2f88-4cf8-a8f4-077c859028fc tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1459 microversion: 2.1 time: 0.175117 Dec 23 12:15:41.580600 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 613/1261] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:15:41 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1459 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:15:42.597144 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-fa1c9808-00ab-4ea5-a1d5-9992eccb9830 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:42.597823 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-fa1c9808-00ab-4ea5-a1d5-9992eccb9830 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:15:42.604238 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fa1c9808-00ab-4ea5-a1d5-9992eccb9830 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:42.604687 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fa1c9808-00ab-4ea5-a1d5-9992eccb9830 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:42.605456 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fa1c9808-00ab-4ea5-a1d5-9992eccb9830 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:42.605885 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-fa1c9808-00ab-4ea5-a1d5-9992eccb9830 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:42.829524 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-fa1c9808-00ab-4ea5-a1d5-9992eccb9830 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:15:42.838133 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-fa1c9808-00ab-4ea5-a1d5-9992eccb9830 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1459 microversion: 2.1 time: 0.244676 Dec 23 12:15:42.838749 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 649/1262] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:15:42 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1459 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:15:42.988791 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-5d3d06a9-d474-4bc2-bf83-8e9293555d0c req-94a09b23-8d49-4dd0-9570-c48566dc5905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1", "name": "network-vif-deleted", "tag": "c267d140-e712-43d0-9e40-a2094d5fe1b4"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:15:42.990313 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:15:42.990313 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:15:42.998256 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-5d3d06a9-d474-4bc2-bf83-8e9293555d0c req-94a09b23-8d49-4dd0-9570-c48566dc5905 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:42.998749 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-5d3d06a9-d474-4bc2-bf83-8e9293555d0c req-94a09b23-8d49-4dd0-9570-c48566dc5905 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:43.010276 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-5d3d06a9-d474-4bc2-bf83-8e9293555d0c req-94a09b23-8d49-4dd0-9570-c48566dc5905 service nova] Creating event network-vif-deleted:c267d140-e712-43d0-9e40-a2094d5fe1b4 for instance ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 on hv-cinder-82282 Dec 23 12:15:43.015400 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-5d3d06a9-d474-4bc2-bf83-8e9293555d0c req-94a09b23-8d49-4dd0-9570-c48566dc5905 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030655 Dec 23 12:15:43.015981 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 614/1263] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:15:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:15:43.859710 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-636dc850-d73f-4a0a-aeda-a8f770ac4d8c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:43.860769 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-636dc850-d73f-4a0a-aeda-a8f770ac4d8c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:15:43.868445 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-636dc850-d73f-4a0a-aeda-a8f770ac4d8c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:43.868904 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-636dc850-d73f-4a0a-aeda-a8f770ac4d8c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:43.869685 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-636dc850-d73f-4a0a-aeda-a8f770ac4d8c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:43.870126 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-636dc850-d73f-4a0a-aeda-a8f770ac4d8c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:43.900923 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-636dc850-d73f-4a0a-aeda-a8f770ac4d8c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:43.901373 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-636dc850-d73f-4a0a-aeda-a8f770ac4d8c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:43.901819 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.objects.instance [None req-636dc850-d73f-4a0a-aeda-a8f770ac4d8c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lazy-loading 'fault' on Instance uuid ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 {{(pid=116354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:15:43.948162 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-636dc850-d73f-4a0a-aeda-a8f770ac4d8c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:15:43.955453 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-636dc850-d73f-4a0a-aeda-a8f770ac4d8c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 200 len: 1231 microversion: 2.1 time: 0.102488 Dec 23 12:15:43.955996 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 650/1264] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:15:43 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:15:44.973923 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3852e570-c945-4fe9-b9e3-4f1787a44871 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:44.974658 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-3852e570-c945-4fe9-b9e3-4f1787a44871 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:15:44.981206 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3852e570-c945-4fe9-b9e3-4f1787a44871 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:44.981654 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3852e570-c945-4fe9-b9e3-4f1787a44871 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:44.982816 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3852e570-c945-4fe9-b9e3-4f1787a44871 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:44.983262 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-3852e570-c945-4fe9-b9e3-4f1787a44871 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:44.996736 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-3852e570-c945-4fe9-b9e3-4f1787a44871 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] HTTP exception thrown: Instance ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 could not be found. Dec 23 12:15:44.997331 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-3852e570-c945-4fe9-b9e3-4f1787a44871 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Returning 404 to user: Instance ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:15:44.998157 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-3852e570-c945-4fe9-b9e3-4f1787a44871 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1" status: 404 len: 111 microversion: 2.1 time: 0.029045 Dec 23 12:15:44.998740 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 615/1265] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:15:44 2021] GET /compute/v2.1/servers/ef1cd1d0-6146-4f0c-a11e-b543ca0bb2e1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:15:48.143522 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-04521c5c-ea37-4b5d-94f8-86e8ed5d1f37 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:48.144143 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-04521c5c-ea37-4b5d-94f8-86e8ed5d1f37 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:15:48.146406 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [req-498fd2c0-18c7-4e6b-93cd-c743d492db03 req-bc8af1ee-c625-4aab-8f81-fa58804ee6df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9cea23a-0a02-42c5-bc21-4fb61f979c10", "tag": "92f81f7f-88ea-428a-96d4-9eee250bbe11"}]} {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:15:48.148019 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:15:48.148019 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: warnings.warn(msg) Dec 23 12:15:48.151253 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-04521c5c-ea37-4b5d-94f8-86e8ed5d1f37 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:48.151699 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-04521c5c-ea37-4b5d-94f8-86e8ed5d1f37 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:48.152466 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-04521c5c-ea37-4b5d-94f8-86e8ed5d1f37 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:48.152953 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-04521c5c-ea37-4b5d-94f8-86e8ed5d1f37 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:48.155821 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-498fd2c0-18c7-4e6b-93cd-c743d492db03 req-bc8af1ee-c625-4aab-8f81-fa58804ee6df service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:48.156330 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [req-498fd2c0-18c7-4e6b-93cd-c743d492db03 req-bc8af1ee-c625-4aab-8f81-fa58804ee6df service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:48.168000 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.compute.server_external_events [req-498fd2c0-18c7-4e6b-93cd-c743d492db03 req-bc8af1ee-c625-4aab-8f81-fa58804ee6df service nova] Creating event network-changed:92f81f7f-88ea-428a-96d4-9eee250bbe11 for instance c9cea23a-0a02-42c5-bc21-4fb61f979c10 on hv-cinder-82282 Dec 23 12:15:48.173126 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [req-498fd2c0-18c7-4e6b-93cd-c743d492db03 req-bc8af1ee-c625-4aab-8f81-fa58804ee6df service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030423 Dec 23 12:15:48.174273 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 616/1266] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:15:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:15:48.179270 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-04521c5c-ea37-4b5d-94f8-86e8ed5d1f37 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Going to try to terminate instance {{(pid=116354) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 23 12:15:48.259485 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-04521c5c-ea37-4b5d-94f8-86e8ed5d1f37 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 204 len: 0 microversion: 2.1 time: 0.119385 Dec 23 12:15:48.260420 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 651/1267] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:15:48 2021] DELETE /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 23 12:15:48.268871 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-26badc0b-cfe0-490d-9822-c48a87a00d9c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:48.269576 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-26badc0b-cfe0-490d-9822-c48a87a00d9c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:15:48.275964 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-26badc0b-cfe0-490d-9822-c48a87a00d9c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:48.276680 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-26badc0b-cfe0-490d-9822-c48a87a00d9c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:48.277466 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-26badc0b-cfe0-490d-9822-c48a87a00d9c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:48.278068 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-26badc0b-cfe0-490d-9822-c48a87a00d9c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:48.486204 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-26badc0b-cfe0-490d-9822-c48a87a00d9c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:15:48.495740 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-26badc0b-cfe0-490d-9822-c48a87a00d9c tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1578 microversion: 2.1 time: 0.230818 Dec 23 12:15:48.496583 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 617/1268] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:15:48 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1578 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:15:49.513955 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-7c9d4168-4625-43e9-828f-62730a2bd61a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:49.514719 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-7c9d4168-4625-43e9-828f-62730a2bd61a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:15:49.521643 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7c9d4168-4625-43e9-828f-62730a2bd61a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:49.522090 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7c9d4168-4625-43e9-828f-62730a2bd61a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:49.522925 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7c9d4168-4625-43e9-828f-62730a2bd61a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:49.523356 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-7c9d4168-4625-43e9-828f-62730a2bd61a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:49.665064 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.policy [None req-7c9d4168-4625-43e9-828f-62730a2bd61a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116354) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:15:49.672532 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-7c9d4168-4625-43e9-828f-62730a2bd61a tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1460 microversion: 2.1 time: 0.162753 Dec 23 12:15:49.673095 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 652/1269] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:15:49 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1460 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:15:50.695390 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-04cd323d-a23d-478b-91e7-ced20ddd034b tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:50.695970 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-04cd323d-a23d-478b-91e7-ced20ddd034b tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:15:50.704520 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-04cd323d-a23d-478b-91e7-ced20ddd034b tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:50.705079 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-04cd323d-a23d-478b-91e7-ced20ddd034b tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:50.706255 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-04cd323d-a23d-478b-91e7-ced20ddd034b tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:50.707153 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-04cd323d-a23d-478b-91e7-ced20ddd034b tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:50.771667 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-04cd323d-a23d-478b-91e7-ced20ddd034b tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:15:50.779267 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-04cd323d-a23d-478b-91e7-ced20ddd034b tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1392 microversion: 2.1 time: 0.088154 Dec 23 12:15:50.779834 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 618/1270] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:15:50 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1392 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:15:51.119887 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [req-b12bd644-48e2-4f73-9be3-bc4d3e2c4732 req-d2418154-8091-40d2-80b0-75a2534da757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cea23a-0a02-42c5-bc21-4fb61f979c10", "name": "network-vif-deleted", "tag": "92f81f7f-88ea-428a-96d4-9eee250bbe11"}]} {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 23 12:15:51.121230 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 12:15:51.121230 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: warnings.warn(msg) Dec 23 12:15:51.130448 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-b12bd644-48e2-4f73-9be3-bc4d3e2c4732 req-d2418154-8091-40d2-80b0-75a2534da757 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:51.131329 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [req-b12bd644-48e2-4f73-9be3-bc4d3e2c4732 req-d2418154-8091-40d2-80b0-75a2534da757 service nova] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:51.145536 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.compute.server_external_events [req-b12bd644-48e2-4f73-9be3-bc4d3e2c4732 req-d2418154-8091-40d2-80b0-75a2534da757 service nova] Creating event network-vif-deleted:92f81f7f-88ea-428a-96d4-9eee250bbe11 for instance c9cea23a-0a02-42c5-bc21-4fb61f979c10 on hv-cinder-82282 Dec 23 12:15:51.150631 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [req-b12bd644-48e2-4f73-9be3-bc4d3e2c4732 req-d2418154-8091-40d2-80b0-75a2534da757 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034966 Dec 23 12:15:51.151221 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 653/1271] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Dec 23 12:15:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 23 12:15:51.800742 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-fef77074-d67d-4b46-979d-2cc369256555 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:51.801943 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-fef77074-d67d-4b46-979d-2cc369256555 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:15:51.812725 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fef77074-d67d-4b46-979d-2cc369256555 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:51.813485 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fef77074-d67d-4b46-979d-2cc369256555 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:51.814865 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fef77074-d67d-4b46-979d-2cc369256555 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:51.815584 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fef77074-d67d-4b46-979d-2cc369256555 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:51.846821 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fef77074-d67d-4b46-979d-2cc369256555 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:51.847293 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-fef77074-d67d-4b46-979d-2cc369256555 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:51.847733 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.objects.instance [None req-fef77074-d67d-4b46-979d-2cc369256555 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lazy-loading 'fault' on Instance uuid c9cea23a-0a02-42c5-bc21-4fb61f979c10 {{(pid=116355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 23 12:15:51.890537 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.policy [None req-fef77074-d67d-4b46-979d-2cc369256555 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28fb997ba3e94ce4a7cff5d5efe7d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65754771daec4e08922a4c10f20ca653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116355) authorize /opt/stack/nova/nova/policy.py:199}} Dec 23 12:15:51.899324 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-fef77074-d67d-4b46-979d-2cc369256555 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 200 len: 1231 microversion: 2.1 time: 0.104853 Dec 23 12:15:51.899922 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 619/1272] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:15:51 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 1231 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 23 12:15:52.921400 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-cb60c186-1423-4b82-ac8f-cbdd41e1efd8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:52.922589 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-cb60c186-1423-4b82-ac8f-cbdd41e1efd8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: c9cea23a-0a02-42c5-bc21-4fb61f979c10] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:15:52.931608 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cb60c186-1423-4b82-ac8f-cbdd41e1efd8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:52.932061 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cb60c186-1423-4b82-ac8f-cbdd41e1efd8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:52.932847 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cb60c186-1423-4b82-ac8f-cbdd41e1efd8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:52.933284 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-cb60c186-1423-4b82-ac8f-cbdd41e1efd8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:52.947429 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-cb60c186-1423-4b82-ac8f-cbdd41e1efd8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] HTTP exception thrown: Instance c9cea23a-0a02-42c5-bc21-4fb61f979c10 could not be found. Dec 23 12:15:52.948013 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-cb60c186-1423-4b82-ac8f-cbdd41e1efd8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Returning 404 to user: Instance c9cea23a-0a02-42c5-bc21-4fb61f979c10 could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:15:52.948828 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-cb60c186-1423-4b82-ac8f-cbdd41e1efd8 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10" status: 404 len: 111 microversion: 2.1 time: 0.034599 Dec 23 12:15:52.949358 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 654/1273] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:15:52 2021] GET /compute/v2.1/servers/c9cea23a-0a02-42c5-bc21-4fb61f979c10 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:15:53.424417 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d0748165-0353-4afd-b1c7-0df2238fe753 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:53.425154 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.compute.api [None req-d0748165-0353-4afd-b1c7-0df2238fe753 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116355) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:15:53.434591 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d0748165-0353-4afd-b1c7-0df2238fe753 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:53.435139 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d0748165-0353-4afd-b1c7-0df2238fe753 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:53.436205 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d0748165-0353-4afd-b1c7-0df2238fe753 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:53.436808 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG oslo_concurrency.lockutils [None req-d0748165-0353-4afd-b1c7-0df2238fe753 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:53.451552 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.wsgi [None req-d0748165-0353-4afd-b1c7-0df2238fe753 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] HTTP exception thrown: Instance 4296b94b-dffe-4ec6-a620-36342be7c07a could not be found. Dec 23 12:15:53.452175 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-d0748165-0353-4afd-b1c7-0df2238fe753 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Returning 404 to user: Instance 4296b94b-dffe-4ec6-a620-36342be7c07a could not be found. {{(pid=116355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:15:53.453002 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-d0748165-0353-4afd-b1c7-0df2238fe753 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 404 len: 111 microversion: 2.1 time: 0.034095 Dec 23 12:15:53.453526 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 620/1274] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Dec 23 12:15:53 2021] DELETE /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 23 12:15:53.462033 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e5f6eff5-8bab-47a2-81c5-38c32cff6331 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '>' {{(pid=116354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:53.462677 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.compute.api [None req-e5f6eff5-8bab-47a2-81c5-38c32cff6331 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] [instance: 4296b94b-dffe-4ec6-a620-36342be7c07a] Fetching instance by UUID {{(pid=116354) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 23 12:15:53.469038 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e5f6eff5-8bab-47a2-81c5-38c32cff6331 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:53.469498 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e5f6eff5-8bab-47a2-81c5-38c32cff6331 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:53.470285 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e5f6eff5-8bab-47a2-81c5-38c32cff6331 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 23 12:15:53.470770 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG oslo_concurrency.lockutils [None req-e5f6eff5-8bab-47a2-81c5-38c32cff6331 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Lock "f84be753-2dc6-40a4-9555-fbe0caef5ac0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 23 12:15:53.484053 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.wsgi [None req-e5f6eff5-8bab-47a2-81c5-38c32cff6331 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] HTTP exception thrown: Instance 4296b94b-dffe-4ec6-a620-36342be7c07a could not be found. Dec 23 12:15:53.484633 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: DEBUG nova.api.openstack.wsgi [None req-e5f6eff5-8bab-47a2-81c5-38c32cff6331 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Returning 404 to user: Instance 4296b94b-dffe-4ec6-a620-36342be7c07a could not be found. {{(pid=116354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 23 12:15:53.485576 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO nova.api.openstack.requestlog [None req-e5f6eff5-8bab-47a2-81c5-38c32cff6331 tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a" status: 404 len: 111 microversion: 2.1 time: 0.027418 Dec 23 12:15:53.486104 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: [pid: 116354|app: 0|req: 655/1275] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Dec 23 12:15:53 2021] GET /compute/v2.1/servers/4296b94b-dffe-4ec6-a620-36342be7c07a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 23 12:15:54.787108 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: DEBUG nova.api.openstack.wsgi [None req-ce5675f0-b2bc-43cf-9b3e-e94e603b6e5e tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] Calling method '.version_select at 0x7fcf287c6e50>' {{(pid=116355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 23 12:15:54.807483 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO nova.api.openstack.requestlog [None req-ce5675f0-b2bc-43cf-9b3e-e94e603b6e5e tempest-TestVolumeBootPattern-1071813703 tempest-TestVolumeBootPattern-1071813703-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2138957045" status: 202 len: 0 microversion: 2.1 time: 0.024133 Dec 23 12:15:54.808491 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: [pid: 116355|app: 0|req: 621/1276] 10.222.0.65 () {58 vars in 1262 bytes} [Thu Dec 23 12:15:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2138957045 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 23 12:18:33.361742 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 23 12:18:33.362869 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: Thu Dec 23 12:18:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 23 12:18:40.083260 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 23 12:18:40.084391 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: Thu Dec 23 12:18:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 23 12:18:45.281054 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 23 12:18:45.281559 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: Thu Dec 23 12:18:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 23 12:18:51.676107 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 23 12:18:51.677064 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: Thu Dec 23 12:18:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 23 12:19:03.887683 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 23 12:19:03.888369 dv-cinder-822821-1-iscsi devstack@n-api.service[116354]: Thu Dec 23 12:19:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 23 12:21:09.524354 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 23 12:21:09.525016 dv-cinder-822821-1-iscsi devstack@n-api.service[116355]: Thu Dec 23 12:21:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!